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SOME LIMITATIONS OF EDUCATIONAL TESTS 
V. A. C. HENMON 
University of Wisconsin 

Standardized educational tests have become so well estab- 
lished and so numerous that it is difficult for even the professional 
student of education to keep up with them. There are two things 
about them that are disturbing and indicate how far we must go 
to make them entirely satisfactory instruments of measurement: 
(1) the very considerable lack of agreement between scores of 
the tests and the well-considered judgment of teachers concern- 
ing abilities in school subjects indicated by the final marks for a 
semester or a year’s work, and (2) the very considerable lack of 
agreement between results of different supposedly standard tests 
in the same subject. 

One would surely be justified in expecting that ability or per- 
formance in a school subject as measured by one standard test in 
that subject would show a reasonable agreement with the same 
ability or performance as measured by another standard test. 
But this is just what the results do not seem to show. When we 
give an intelligence test and find a correlation of only 0.50 or 
0.60 between it and general scholarship, we hasten to say that 
success in school work is dependent upon many factors of which 
intelligence is but one, and that 0.60 is about as high a correla- 
tion as we can expect to find. When we give subject-matter 
tests, on the other hand, we are supposedly measuring classroom 
products more or less directly, not indirectly, as when we measure 
native intelligence, and they should surely be expected to show 
rather close agreement with each other and with teachers’ ratings. 
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Few days go by in which I am not asked to recommend some 
intelligence test or some standard educational test. This is a 
common experience to members of departments of education. 
There is, however, little information available as to the relative 
merits of different tests and scales, or as to their validity, reli- 
ability, and usefulness. Mere opinion, based on respect for an 
author’s standing and workmanship and the popularity of his 
scale or test, we have wisely learned to distrust. 

In order to secure information and a better basis for recom 
mendation, comparative studies have been made of results with 
different tests in American history, algebra, and reading. In 


each case, two independent sets of measures were secured. 


History TEsts 


Six American history tests—Bell and McCollum, Barr 
(Test IV), Buckingham, Starch, Van Wagenen, and Harlan— 
were given to two senior groups in the high school at Stevens 
Point, Wisconsin. The first group (1920) numbered sixty; and 
the second group (1921), sixty-four.’ The tests were given in 
the spring after the work of the course for the year, based on 
Muzzey’s “American History” as the text, was completed. The 
Barr Test IV, and the Van Wagenen Scales were not given to 
the 1920 classes, but added to the other four in the 1921 tests 

The tests are clearly of two types: those that measure in- 
formation concerning the facts of history, and those that measure 
thought or historical judgment. The Bell-McCollum, Starch, 
and Harlan tests are informational tests only; Barr’s Test IV, 
which was the only one of his tests used, is a thought or judg 
ment test, while Buckingham and Van Wagenen have tests of 
both types. The scores and correlations were worked out sepa- 
rately in the last two tests. As criteria, against which the scores 
might be checked, the average of the two semester’s marks in 
history, and the average of the grades assigned in all other sub- 


jects, and a composite score based on all the tests, were used. 


*From an unpublished Master’s thesis by Paul M. Vincent. 
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* 
C The correlations with the teacher’s marks and intercorrela- 
tions for the 1920 group appear in Table I and those for the 
1921 group in Table II. The correlations were calculated by the 
TABLE I. COEFFICIENTS OF CORRELATION FOR SIXTY HIGH- 
SCHOOL SENIORS IN VARIOUS HISTORY TESTS (1920) 
l ————__—_——- 
~ si 
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History Grades 
Average of Other Grades | .56 
Starch 57 32 
Juckingham Thought 30 36 19 
Buckingham Information 49 35 57 40 
Harlan 72 43 68 23 66 
Bell and McCollum. . 65 38 70 22 65 82 
Average 50 40 50 32 52 4 57 


rABLE II. COEFFICIENTS OF CORRELATION FOR SIXTY-FOUR HIGH 
SCHOOL SENIORS IN VARIOUS HISTORY TESTS (1921) 
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History Grades. .| 
Average of Other 
Grades | .2@2 | 
Starch | .35 
Buckingham 
Thought. 34 | .21 23 
Buckingham | | 
Information | .45 42 27 23 
Harlan 60 52 51 18 31 
sell and 
McCollum 65 | .56 71 16 36 72 
Var Wagenen | 
Thought | 42 37 50 26 39 52 ,52 
VanWagenen 
Information | .58 56 65 19 24 76 64 58 
Barr ‘ | 121] .22 |--.08 07 19 U2 07 203 O04 


Average 48 | .44 39 21 32 16 49 42 47 09 
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product-moment formula. The tables have not been burdened by 

the addition to each coefficient of its probable error. Anyone can 

determine it by the usual formula, P.E., = .6745 ee wee 
) > 

a coefficient of 0.50 it is in these tables approximately 0.06 

which indicates the limits within which the coefficients are 

reasonably reliable. 

These tables show both the considerable lack of agreement 
between the teacher’s final marks and scores in the tests, and also 
the lack of agreement between the tests themselves. The corre- 
lations between the teacher’s marks and the scores in the tests 
range from 0.12 to 0.72 with an average for thirteen coefficients 
of only 0.48. This is not an impressive agreement, and does 
not inspire great confidence in the validity of the measuring in- 
struments. It is somewhat surprising and disconcerting to find 
that we could predict the teacher’s final mark in history by 
taking the average of the pupil’s marks in all other subjects, as 
well as by the scores in any of the standard tests in history. In 
fact, the prediction would be better than with the majority of 
the tests. In Group II the correlation between the history grades 
and the average of all the other grades, 0.72, is higher than the 
correlation between the teacher’s marks and the history tests, 
except one. One may, to be sure, urge that the teacher’s judg- 
ment is subject to much error and that the criterion is inade 
quate. On the other hand, a teacher is not likely to be interested 
in nor likely to use a forty-minute test, and place reliance upon 
it, when its results differ greatly from the judgment based on a 
year’s acquaintance with a pupil’s work and ability. He will 
challenge the validity of the test and decline to use it, particu 
larly if he experiments with several different tests and finds such 
disagreement between them that the results depend a great 
deal on the test used. The agreement between the different 
tests for the 124 pupils ranges from —o.08 to 0.76 with an aver- 
age for 43 coefficients of only 0.40, again an unimpressive agree- 


; 


ment, and one that breeds scepticism concerning the reliability of 


the tests. 








\ 








yer 


ve of 0.58 for sixteen coefficients. 


bili 


judging pupil’s knowledge and ability in history. 
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The situation is improved somewhat if the coefficients are 
nsidered separately for the informational tests and the judg- 
ent tests. The average of the coefficients between the informa- 


nal tests alone and the teacher’s marks is 0.57 instead of 0.48, 


while of four coefficients based on thought questions alone the 


ig The intercorrelations between the dif- 


ige is only 0.295. 


erent informational tests range from 0.24 to 0.82 with an aver- 


For the three coefficients of 
tercorrelation between the thought tests, the average is only 
9. It is evident that the teacher’s judgment of the pupil’s 


1 
i 


ty in this case, at least, is based upon his usable knowledge 
f essential historical facts. This is a relatively definite objective 


+ 


t In 


ng, and it is likely that the great majority of teachers use i 
Tests of the 


nformational type are likely to be rated most highly by teachers, 


On this basis of selection 


ahe ad 


; 


reit 


Harlan and Bell-McCollum tests would rank distinctly 


re, and to be most widely used. 


the others in practicability. 
If, instead of using the teacher’s marks, one uses a composite 
e by combining the scores in all the tests equated to give each 


1 Table IIL. 


t 


equal weight, the correlations are those given in 


ABLE III. CORRELATIONS WITH COMPOSITE OF ALL TESTS 
AS CRITERION 
1920 Group 1921 Group 
Starch 87 83 
Bell-McCollum SS 78 
Harlan 86 70 
VanWagenen Thought 74 
Buckingham Information 85 55 
VanWagenen Information 70 
Buckingham Thought 18 ) 
Barr 29 
Teacher’s marks 61 63 
It is noteworthy that the correlations between the composite 
d teacher’s marks are not as high as with several of the tests 
ken singly. Even if the information tests alone are pooled 
into a composite the correlations with teacher’s marks 1s 0.06 


hich is no higher than with one of the tests alone. 
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By this method of evaluation the tests occupy about tl 
same relative positions except that the Starch test ranks co 
siderably higher. The Van Wagenen thought test takes a bette: 


position than his information test 


ALGEBRA TESTS 


Four algebra tests—Monroe, Rugg-Clark, Hotz, and Str 
quist—were given to 100 first-year pupils, fifty boys and fift 
girls, in an Omaha high school at the close of the school yea 


} 


The Coleman test was given to some of the pupils, but the result 
are not reported here. The Douglas tests were not availabl 
when these experiments were made. In order to secure two s 
of coefficients the pupils were divided into two groups, A and 
fifty in each group. As criteria against which to check the t 
scores the teacher’s marks for the year’s work, and the scores i 
\rmy Alpha, which happened to be available, were used. T 
Pearson correlations and intercorrelations were determined 
attempts, rights, and also for an accuracy score based on 


relation between attempts and rights. The coefficients based 


rights are reported in Table IV. 


TABLE IV\ COEFFICIENTS OF CORRELATION FOR ONE HUNDI 
FIRST YEAR HIGH-SCHOOL, PUPILS IN VARIOUS ALGEBRA TESTS 


Algebra Army Rugg- ~ 
Grades Alpha Monro Clark Hot: 
Army Alpha A 37 
B 15 
Monroe 4. 50 26 
B. 45 29 
Rugg-Clark \ 67 30 67 
B. 39 30 77 
Hotz \ 54 oe 31 58 
B 52 34 36 60 
Stromquist 72 51 53 78 74 
B 60 23 61 80 70 


From an unpublished Master’s thesis by Maybel Ward Burns. 


——————— eee, 
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The correlations with the teacher’s marks for the different 
tests ranged from 0.39 to 0.72 with an average for the eight 
coefficients of 0.55. The incorrelations between the different 
tests range from 0.31 to 0.80 with an average for the twelve 
coefficients of 0.62. The results show substantially the same situ- 
ition as in the history tests. Unfortunately, the average of the 

arks in other subjects was not obtained, but from numerous 
other studies of such relationships, it may be inferred that the 
correlations between the algebra marks and the average of marks 
in other subjects would be in the neighborhood of 0.50 or 0.60 
In other words, prediction of the final mark in algebra could have 
been made almost as well by the average of all other marks as by 
any algebra test. 

If agreement with the teacher’s marks is used as a basis for 
selection, there are no marked differences, as in history, in the 
relative values of the tests, though the least well known—the 
Stromquist test—seems somewhat superior to the others in this 
Case, 

If a composite score based on the scores in the four tests 
equated to give equal weight to each test is used as a criterion, 


the correlations are as in Table V 


TABLE V. CORRELATIONS WITH THE COMPOSITE OF ALL TESTS 
AS CRITERION 


Group A Group B 
Rugg-Clark 92 94 
Stromquist 92 91 
Monroe. 75 77 
Hotz.. 75 72 
73 53 


Teacher's Marks 


As in the history tests the agreement with the teacher's 
judgment is no closer than with several of the tests taken alone. 
From this point of view the validity and reliability could not be 
improved by using all the tests. It might be that a combination 
of two of the tests could be found which would yield a higher 


correlation, but in view of the relatively low correlation between 


the composite and the teacher’s marks, it scarcely seemed worth 
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while to exhaust the permutations and combinations to discover 
such a team of tests. 

With the composite as a criterion the Rugg-Clark and Strom- 
quist tests yield notably higher correlations than the other two 


READING TEsts 

The following reading tests were given to two groups of 
pupils, twenty-seven in a fifth grade, and thirty-one in a sixth 
gerade °° 

1. Courtis Silent Reading Test, No. 2 
Fordyce Scale for Measuring Achievement in Reading, Tests 

[ and II 
Kelly-Kansas Silent Reading Test, Tests I and II 
Monroe Standardized Silent Reading Test, Form I, Tests II 


5. Brown Reading Test 
6. Starch Reading Test, No. 5 and 6 
7. Thorndike Scale Alpha 2, Part II 


8. Burgess Russell Sage Foundation Test 


The tests were all given with strict conformity to directions, 


within the period of one week, during the last month of the 


TABLE VI. COEFFICIENTS OF CORRELATION FOR TWENTY-SEVEN 
FIFTH-GRADE PUPILS AND THIRTY-ONE SIXTH-GRADE 
PUPILS IN VARIOUS READING TESTS 
FIFT H-GRADE—S PEED 





| Courtis | Fordy« e ( iTay Brown 
Courtis 
Fordyce 75 
Gray 62 66 
Brown 79 73 52 
Starch SS 73 43 65 


SIXT H-GRADE—SPEED 





Fordyce Gray Brown Starch 
Fordy ce 
Gray = 77 
Brown 53 63 
Starch 63 57 42 ; 
Monroe 31 3 59 44 





* From an unpublished Master’s thesis by Olaf K. Thollehaug. 
I A 4 














I} 


hich range from 0.02 to 0.7 


ays and the tests vary considerably in character 
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rABLE VII. COEFFICIENTS OF CORRELATION FOR FIFTH-AND 
SIXTH-GRADE PUPILS IN VARIOUS READING TESTS 
FIFT H-GRADE—COM PREHENSION 


Courtis | Fordyce Gray Starch Burgess | Kansas 
Irtis . | | 
rdyce 42 | | 
ray | 16 58 
ircn 40 14 25 
"TESS 41 02 03 33 
nsas 59 14 18 66 66 
rndike 56 21 29 50 59 77 
SIXT H-GRADE—COM PREHENSION 
Fordyce Gray Starch Monroe Burgess 
ravce — 
ray 33 
tarch 41 25 
nroe 54 61 17 
irgess 49 50 38 67 
rndike 35 39 O8 58 10 


ol year. No two tests were given during the same half day. 


papers were all scored in accordance with the directions ot 


ithors, except the Thorndike test, in which case the papers 

‘re scored on a basis of number of questions right in order to 

nk the pupils on a finer scale. The correlations were worked 
by the Spearman rank formula, and appear in Tables V1 
VII 


The correlations show a disappointing lack of agreement, 
th in speed and in comprehension. In speed the coefficients 
ge from 0.38 to 0.88 with an average for twenty coefficients 

60. This is higher than the correlations for comprehension 


7 with an average of 0.40. When 


isures of speed of reading show a coefficient of resemblance 


agreement of only 0.6 and in comprehension of only 0.4 we 
th " 7 7 


© LeSstS dd 


ome suspicious of the validity and reliability of 
ctical instruments. Reading ability is defined in very different 
* One might 


Courtis, 8. A. The Gary public schools: Measurement of classroom 
cts. New York: General Education Board, 1918. 5352 pp. 
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expect a closer agreement between tests similar in general make- 
up. Thus a closer agreement might be looked for between the 
Starch, Brown, Gray, and Fordyce tests. These tests give greater 
emphasis to reproduction of thought and immediate memory 
The Kansas, Monroe, Burgess, and Thorndike tests measure the 
ability to understand and to follow directions, and they make a 
greater demand upon judgment. While the results tend to sup- 
port the expectation, there are, however, no marked differences 
For the purpose of comparing the results of closely similar types, 
the Brown and Starch tests were given and scored in the same 
manner. The correlation for the fifth-grade group was 0.61 and 


for the sixth-grade group was only 0.34. 


‘ 


Results similar to these have already been reported for rea 
ing tests. Richards and Davidson® report a correlation of 0.25 


between the Kansas and Starch tests. Courtis,® speaking 
reading tests in the Gary survey, says, “One would seem to hav 
a right to expect that the reading abilities of the children as 
revealed by one test will show some agreement with the readi1 
abilities revealed by the next test, since both are tests of reading 
ability. This, however, is precisely what the results do not show.” 
Starch’ found a closer agreement, the correlations between tl 
Starch and Kansas tests for fifth- and eighth-grade pupils being 
0.56 and 0.50. Franzen,* in this JOURNAL, reports correlations 
for three reading tests with one class of 40 children as follows 
Monroe-Thorndike-McCall, 0.26; Burgess-Thorndike-McCall 
0.19; and Monroe-Burgess, 0.48. He points out that “it 
obvious from the data at hand that we need to investigate our 
reading tests.” 

In order to get some measure of the relative values of th 
various tests, two criteria were employed, one consisting of the 


Richards, A. M., and Davidson, P. E., ‘‘Correlations of single measur 


of some representative reading tests,’’ School and Society, 4:375-77. S 


tember 2, 1916. 


Courtis, S. A.. Op. cit., p. °65. 


Starch, D. ‘‘Reliability of reading tests,’’ Schoo! and Society, 8:86-9 


July 20, 1918. 


*Franzen, Raymond. ‘‘ Attempts at test validation,’’ Journal of Ed 
cational Research, 6: 145 58, September, 1922. 
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verage of all the tests combined with the teachers grades, 


verage of the tests counting one-half and the teacher’s gr 


reading ability. In calculating these coefficients the averag 


~ 


rank in speed and rank in comprehension was used 
st scores. The results appear in Tables VIII and IX. 


POSITE SCORE OF ALL TESTS AND BETWEEN READING 
TESTS AND TEACHER’S RATINGS 





ngly low. If the teacher’s judgment is taken as a criterion, 


tests would rank in relative value as they appear in Table \ 
the composite criterion is chosen, the ranks would differ 
ttle except for the position of the Monroe and Thorndike t 
[f the teacher’s ratings be disregarded and a composite 1 
tests is used as a criterion, the resulting correlations with 
and with the teacher’s estimates of reading ability are 
| 

es in a striking way the unsatisfactory state of our rea 

There is an abstractness about correlation coefficients 

kes it difficult to realize their concrete significance Ani 


tion or two will show the situation in individual cases 





lable IX. The highly erratic character of these results em] 
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the 


ades 


ne-half, the other being the teacher’s ratings of the pupils in 


e ol 


for 


BLE VIII. CORRELATION BETWEEN READING TESTS AND COM 


Correlation between Reading | Correlation between Reading 
Tests and Composite Score Tests and Teacher’s 
Testa of all Tests Ratings 
Fifth Sixth Average Fifth Sixth Average 
Grade Grade Grade Grade 
ourtis 83 3 67 67 
Grav 83 83 83 72 67 69 
M roe 79 79 55 55 
Tomees 77 77 60 60 
Thorndike 77 74 75 60 65 62 
Starch 73 76 75 50 65 57 
Fordvce 69 SO 75 59 52 56 
gess 58 76 67 10) 7 18 
\s compared with the history and algebra tests the corre- 


ns with teacher’s estimates are higher, but are disappoint 


the 
IT] 
very 


ests 


from 
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TABLE IX. CORRELATIONS WITH COMPOSITES OF ALL TESTS 


Speed | Comprehensior 
teading Tests eading Tests at 
peti Tein Firth | Sixth | “oocins “est Fifth | Sixth 
Grade | Grade Grade | Grade 
Courtis 95 : Kansas... 85 
Fordyce 83 .84 |Monroe.. 81 
Brown 87 79 |Burgess 68 80 
Starch 86 75 |Courtis 70 
Gray... 70 86 (Starch 73 60 
Monroe... .61 /|Thorndike 76 56 
Teacher's Ratings in Gray.... 52 75 
Reading Ability 74 37 |Brown 66 60 
Fordy¢ e 12 0S 
Teacher’s Ratings 
(Reading) 66 55 


group of 27 pupils one of the reading tests ranked a pupil secot 


i 


in comprehension; another, sixteenth; and a third, twenty-sixtl 


In the first case he is near the top, in the second he is an averag 


I 
in speed, in a group of 31 pupils, one pupil is rated second ; 
third by two tests, twenty-eighth by another test, and thirteet 
and fifteenth by two others. Reading ages or achievement ag 
for such pupils will vary enormously and can have little signi 


cance. That such cases can occur at all is a serious matter, | 


when they occur not only occasionally, but with considerabl 


frequency, the matter becomes still more serious. 


DISCUSSION 


The results of each set of experiments, and they are in fun 


mental agreement, are at best discouraging. Thorndike 


with some accepted criterion of 0.80 and an attempt is made 
the test or tests to assign individuals to their proper tenths, 
should be right only twenty-three times out of a hundr 
Jordan® has recently extended the calculations and has shi 
that with a correlation of 0.70 if we wished to assign individu 


to their proper fifths, which would agree with the ordinary fiv 


performer, and in the third he is near the foot of the class. Ever 


pointed out that if a test or a team of tests yields a correlatio 


( 


*Jordan, A. M. ‘‘Correlations of four intelligence tests with grades, 
Journal of Educational Psychology, 13:429, October, 1922. 


, 
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point marking system, we would be right only forty times out of 
a hundred. If the assignment is made by thirds, or into A, B, 
and C sections, we would be right only fifty-five times out of a 
hundred. If that is the case, our educational tests are clearly 
subject to very marked limitations as practical measuring instru- 
ments. It is likewise evident that when the less valuable tests 
have been weeded out, the remainder will need revision, recon 
struction, and supplementation. 

When educational tests were first developed, it was thought 
and frequently urged, that they would be most useful in surveys 
and in comparing schools and classes but of doubtful value for 
the study of individual pupils. It was also not infrequently 
pointed out that the tests were measures of performance in cer 


tain specified activities under standardized conditions and could 
necessarily be regarded as measures of ability in school sub 
jects. This has been forgotten recently, however, in the elaborate 
Iculations of achievement ages and achievement quotients for 
ndividual pupils. These are then taken as measures of abili 
chool subjects as well as measures of individuals. The writer 
has no lack of faith in the ultimate development of educational 
tests, but in the light of such data as are available, he is skeptical 
f the validity and the reliability of achievement or accomplish 
ment quotients in history, algebra, and reading, and is doubtful 
whether we can legitimately and safely claim to measure educa 
tional products with sufficient accuracy to go much beyond the 
comparison of schools and classes 
We have been too much influenced by motives of econon 
time, money, and energy. In using intelligence tests, we | 
found a thirty-minute test inadequate except for rough classifica- 
tion in a very heterogeneous group and most students of inte 
gence tests would probably agree with Thorndike that two 
hundred minutes of testing is mecessary to secure 
reliable result with older pupils. Just so, in measuring educa- 
tional products we must contemplate a more comprehensive and 
time-consuming program. It is noteworthy that the correlations 


between a teacher’s estimate and the best of the intelligenc: 
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tests are higher than in the case of educational tests, and also 


that the intercorrelations between the different intelligence tests 


are much higher than between different educational tests in the 
same subject. It appears almost as if we have been taking both 
the validity and the reliability of subject-matter tests for 
granted. 











THE CONSTRUCTION AND INTERPRETATION 
OF CORRELATION TABLES 
EpWarpD L. THORNDIK! 
Institute of Educational Research 
Teachers College, Columbia 07 wersity 
It is the purpose of this article to explain and illustrate a 
ethod of making correlation tables from given hypotheses 


ut 


the causes which produce the correlation Making and 
specting such tables will give an insight into the meaning of 
rrelation tables, diagrams, and coefficients which is limited 
w to a very few experts in this field. It also results in a nut 
of intrinsically valuable observations. The procedure to be 
vn also makes it easy to construct a “theoretical” correlation 


ble representing a given hypothesis, and to compare observed 


rrelation therewith, as we construct a theoretical frequency 
rve and compare an observed set of frequencies wit! 

My procedure is almost childish in its mathematics, but it 
ems to me to be more instructive to most students of psy- 


; 


logy and mental measurements than a generalized treatment 
th calculus would be. I shall be gratified if such a generaliza 
1 is made by some one possessed of the mathematical te hnique 


hich I lack. Even if this is done, the present treatm 


bably be useful as an introduction to the generalized treat 
nt, and for non-mathematical workers will take the plac« if 
Let A and B be two quantities, like height and arm stretch 


ability with words and ability with numbers, which vary in 
gnitude among individuals and are positively, but nm 
tly, correlated in the sense that the amount of A which 
lividual possesses corresponds somewhat to the amount of B 
hich he possesses. 

For A and B to be positively but not perfectly correlated 
eans that A and B are produced by certain causes some of 


+ @ 


hich are identical for A and B, whereas others act only on A 


‘This investigation is one of a series madi 
epic Corporation. 
199 








PSS?" Ser 


“=e. 





200 JOURNAL OF EDUCATIONAL RESEARCH Vol.7, No.3 


and others only on B. Call these the AB causes, the A causes, 
and the B causes, respectively. 

Consider a population of 320,000 (taken arbitrarily at this 
number) and consider the correlations that will result according 
to certain conditions with respect to the AB, A, and B causes 

Assume that the amounts of A, if only the AB causes acted, 


would be as shown below: 


Frequency 


Amount of A in Percents 
K 0.5 
K+ 1 1.5 
K+ 2 4.5 
K+3 9.0 
K+ 4 15.0 
K+ 5 19.5 
K +6 19.5 
K+7 15.0 
K+8 9.0 
K+9 4.5 
K + 10 r.5 
K-+11 0.5 


(Any form of distribution could be used as well without in 
pairing the later argument. This, which is closely the so-called 
“normal” distribution, is taken as a form to which approxim 
tions are often encountered in mental and social measurements 

Call the amount of B produced by the AB causes that pr 
duce K of A, C. Call the amount of B produced by the AD 
causes that produce K+1 of A, C+1. (This might be called 
C+-2 or C+% or C+0.7432, or any number without impairing 
the later argument in any way, but the computations would b 
much more laborious to make and to follow. ) 

Case I].—If only the AB causes act, every individual having 
K of A will have C of B, every individual having K4-1 of A 
will have C+1 of B, and so on. The correlation will of cours: 
be perfect and the correlation table will be as shown in Table | 


A break below perfect correlation occurs only when the caus¢ 


» 


influencing the variables A and B are not identical. 
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TABLE I. CORRELATIONS, ONLY THE AB cAl SES OPERATIVE 
K |K+1\/K+2) K+3) K+4/ K+5) K+6 K+7| K+8) K+9 K+10| K+11 


1600 


+2 14400 


+4 48000 


) 62400 
+t 62400 
7 48000 


+-§ 28800 


L10 4800 


2.0% 1600 


Case I1].—Suppose now that the AB causes act and also cer 
in B causes, but no A causes. Suppose that the B causes are 


such as have in general this result: 


In 2% cases out of 100 they lower a person by 4 
In 5 cases out of 100 they lower a person by 3 
In 12% cases out of 100 they lower a person by 2 
In 17% cases out of 100 they lower a person by 1 
In 25 cases out of 100 they lower a person by 0 
In 17% cases out of 100 they raise a person by I 
In 12% cases out of 100 they raise a person by 2 
In 5 cases out of 100 they raise a person by 3 
In 2% cases out of 100 they raise a person by 4 


Any 


uld be used without impairing the later argument. This ar 


arrangement of resulting effects from the 


rangement is taken as a common case where the causes act 


tten to raise as to lower B. ) 


Then the 1600 individuals who would be K in A by the action 


of the AB causes will still all be just K, but in B 40 of them will 


be, not C, but C—4; 80 of them will be, not C, but C—3; 





200 of them will be C—2z; 
them will be C; and so on. 


The 4800 individua 


280 of them will be C 


400 of 
Ils who would 
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be K+1 in A by the action of the AB causes will still all be 
K-+1, but in B 120 of them will be C—3, 240 of them will be 
C—2, and so on. The correlation table will be as shown in 
Table II. Table II differs from Table I in two respects. First, 
the variability of the population in B has been notably increased 
by the addition of the B causes to the AB causes. Second, 
whereas, with perfect correlation, individuals who were C in B 
averaged K in A, they now “regress” toward the general central 
tendency of A, averaging about K+-2.4. Similarly those indi- 
viduals who are C+1 in B do not now center at K+1 but 
nearly at K+-3. 

Case II].—Suppose now that the AB causes act as hitherto, 
and the B causes as in the previous case, and that there also act 
certain A causes such as have in general this result: 


In 71% cases out of 100 or 3 in 40 they lower a person’s A by 2 
In 22% cases out of 100 or 9 in 40 they lower a person’s A by 1 
In 40 cases out of 100 or 16 in 40 they lower a person’s A by 0 
In 22% cases out of 100 or 9 in 40 they raise a person’s A by 1 
In 7% cases out of 100 or 3 in 40 they raise a person’s A by 2 


We now have for any 1600 individuals who would, by the 
AB causes alone, be K and C or K+ 1 and C+1, or K+2 
and C+-2, a scattering as follows: 120 of them will be lowered 
2 in A; of these 3 will be lowered 4 in B, 6 will be lowered 3 
in B, 15 will be lowered 2 in B, 21 will be lowered 1 in B, 30 will 
be lowered o in B, 21 will be raised 1 in B, and so on. 360 of 
them will be lowered 1 in A; of these 9 will be lowered 4 in B, 
18 will be lowered 3 in B, 45 will be lowered 2 in B, 63 will be 
lowered 1 in B, and so on. 

If, for example, we take the 4800 individuals who, by the 
AB causes alone, would all be K+-1 in A and C-+1 in B, they 
will scatter as shown in Table III. If we take the 320,000 indi- 
viduals that would be as in Table I by the AB causes alone they 
will produce Table IV. The variability of both A and B are 
increased by the addition of the A and B causes to the AB 
causes, and there is now “regression” both toward the central 
tendency in A and toward the central tendency in B. 
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be K+1 in A by the action of the AB causes will still all be 
K-+1, but in B 120 of them will be C—3, 240 of them will be 
C—z2, and so on. The correlation table will be as shown in 





Table II. Table II differs from Table I in two respects. First, 
the variability of the population in B has been notably increased 
be tha additinn af the R canses to the AB causes. Second, 
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will scatter as shown in Table ITI. If we take the 320,000 indi- 
viduals that would be as in Table I by the AB causes alone they 
will produce Table IV. The variability of both A and B ar 
increased by the addition of the A and B causes to the AB 
causes, and there is now “regression” both toward the central 
tendency in A and toward the central tendency in B. 
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TABLE III. ANALYSIS OF THE 4,800 INDIVIDUALS WHO BY AB 
CAUSES ALONE WOULD BE &+1r IN A AND c+11N B 





















































| K-1 K | K+1 K+2 | K+3 | Total 

C-3 | 9 27 48 27 | 9 120 
C-2 18 54 96 54 | 18 240 
C-1 45 135. | 240 135 | 45 600 
Cc 63 189 336 is9 | 63 840 
c+1 | 9 | 270 480 270 | 90 1200 
C+2 63 | 189 336 189 | 63 840 
C+3 45 135 20 | 135 | 45 600 
C+4 18 54 96 | 54 | 18 240 
C+5 9 | a | 4 | 27 | 9 | 120 
Total | 360 | 1080 | 1920 1080 | 360 4800 





Case I1V.—Consider now a more complicated arrangement of 
the A causes and B causes. Let the AB causes be as before. 
Let the A causes act as in the case of Table IV. Let the B 
causes now vary in their nature in relation to the magnitude of 
the B as determined by the AB causes, and in such fashion that 
when the AB causes alone would produce C of B, the B causes 
produce effects of —1 three times in 40, 0 thirty-four times in 
40, and -++1 three times in 40; when the AB causes alone would 
produce C-++1, the B causes produce effects of —1 six times in 
40, O twenty-eight times in 40, and +1 six times in 40; and so 
on as shown in Table V. 

Table IV and any table of the same sort reveals an inade- 
quacy in the orthodox teaching that the variability of any array 
of the B’s in a “normal” correlation table will be the same as 
that of any other array of the B’s, and will be V 1—r* times 
the variability of the total population of the B’s concerned in 
the correlation. The arrays of the B’s toward one or both of 
the extremes will on the contrary always have less variability 
than those toward the center, since their variability is at the 
extremes only that produced by the B causes, whereas as we 
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approach the center the A causes act to commingle in one array 
individuals who by the AB causes alone would have been kept in 
distinct arrays. So some of the AB causes of variability com- 
bine with the B causes to produce the observed variability of the 
more central arrays. The same holds for arrays of the A’s 
against any one value of B. 

The resulting correlation table is Table VI. This shows that 
although the distribution of variable A and variable B by the 
AB causes alone was symmetrical and of the “normal” form, and 
although the effect of the A causes at each single magnitude of 
\ (as determined by the AB causes only), and of the B causes at 
each single magnitude of B (as determined by the AB causes 
only), was symmetrical and of the “normal” form, the increase 
if the effect of the B causes in relation to the AB magnitude 
has produced a skew in the variable B in the whole population, 
a skew in each array of B’s, (save the two extremes) and a bend 


of the line showing the relation of A to B. 


rABLE V. THE EFFECTS PRODUCED BY THE B CAUSES IN RELA 
rION TO MAGNITUDE OF B DUE TO THE AB CAUSES ONLY 


— Magnitude of B 

‘ 

Effects of 7 sina eceemmeaiipipaiesietncsamnanp iadinscasaiiibaeadtiaeniiahi 
the B Cicicreicici¢Cci¢Cgicgi¢ci¢gcic 
Causes +1) +2) 4+3/ +4] +5] +6] +7| +8) +9/+10/4+11 

—6 1|] 1 
_5 tele 
= 1] 2] 2] 2] 2 
-3 l 1} 2] 2] 4] 3] 3] 3 
—2 2 2 i 5 5 4 5; 4 t 
=} 3/ 6/10/10/10| 9| 8| 7/ 7] 6] 5] 5 

0 34 | 28 | 20 | 16 | 14 12 | 10; 10 8 | 6 8 6 
+1 3 6 | 10); 10} 10 9 8 7 7 6 | 5 5 
+2 2 2 4 7) 5 } 5 4; 4 
+3 l l 2{| 2 4; 3) 3] 38 
+4 1; 12] 2] 2] 2 
+5 |} 1 l 2 
+6 l l 


Case V.—Consider now a case where the AB causes act 
before. and where both the A causes and the B causes act as the 


B causes did in Case IV (Table VI). The resulting correlation 


table is Table VII. We have skew in both directions, skew in all 
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arrays save the extremes, and bend in the relation lines of A to B 


nd of B to A (which are identical here). The bend is shown 
in Figure 1. 

One of the important uses of correlation tables is in the case 
f “self-correlation” where two imperfect measures of the same 
thing are correlated, the drop below perfect correlation or the 
“attenuation” being an index of the imperfection of the measures 
In this case the AB causes are those which act to produce per- 
fect measures, the A causes being the causes of “error” in the A 
measures, and the B causes being the causes of “error” in the 
} measures. One may therefore construct correlation tables to 
represent any hypothesis in which one is interested concerning the 
nature and amount of the errors in A and B. For example, let 
us assume that A and B are imperfect measures of the same 
fact; that if this fact were perfectly measured it would be dis- 
tributed as shown in Table VIII; that the A measures of it are 


iflicted with an error such as makes a person’s A score too small 


Kel WK Wel Ke eS ie Ke eh Ke? Kf WD? Ke Mol) Me oi Wot Mls Ke 47 











FIGURE 1. THE RELATION LINE OF TABLE VII. THE CONTINUOUS 
LINE IS FOR THE AVERAGES OF THE ARRAYS, THE DASH LINE 
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or too large as shown in Table IX; and that the B measures of 
it are afflicted by an error which makes a person's B score too 
small or too large as shown in Table X. Since these supposi- 
tions duplicate in statistical effect the suppositions of Case III 
above, the correlation table will be exactly Table 1V, except that 
for C—2, C—1, C, ¢ 
K, ete., K-+1, etc., since the A and B series are both measures 


‘ 


+1, etc., we should read _ K—2, K—1, 


of the same thing. 
As a second example, let us assume that A and B are im- 
perfect measures of the same fact; that, if this fact were per- 


fectly measured in the group in question, it would be distributed 


TABLE VIII. THE DISTRIBUTION OF THE FACT WHEN 
PERFECTLY MEASURED 


Amount Frequency, in 


of A Percents 
K | 0.5 
K+1 1.5 
K+2 4.5 
K+3 9.0 
K+4 15.0 
K+5 19.5 
K+6 19.5 
K+7 15.0 
K+8 9 0 
K+9 4.5 
K+10 1.5 
K+11 0.5 


TABLE IX. AMOUNT OF ERROR DUE TO THE A CAUSES 


In 3 cases in 40 they lower a person’s score in A by 2 
In 9 cases in 40 they lower a person’s score in A by 1 
In 16 cases in 40 they lower a person’s score in A by 0 
In 9 cases in 40 they raise a person’s score in A by | 
In 3 cases in 40 they raise a person’s score in A by 2 


TABLE X. AMOUNT OF ERROR DUE TO THE B CAUSES 


In 1 case in 40 they lower a person’s score in B by 4 
In 2 cases in 40 they lower a person’s score in B by 3 
In 5 cases in 40 they lower a person’s score in B by 2 
In 7 cases in 40 they lower a person’s score in B by 1 
In 10 cases in 40 they lower a person’s score in B by 0 
In 7 cases in 40 they raise a person’s score in B by 1 
In 5 cases in 40 they raise a person’s score in B by 2 
In 2 cases in 40 they raise a person’s score in B by 3 
In 1 case in 40 they raise a person’s score in B by 4 
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ws as shown in Table VIII; that the A measures of it are afflicted 
7 with an error such as makes a person’s score too small or too 
cl large as shown in Table V; and that the B measures of it are 
i afflicted by an error of the same nature and magnitude. Since 
1. these suppositions duplicate in statistical effect the suppositions 
I, of Case V above, the correlation table will be exactly Table VII tf, 
” except that for C—1, C, C+1, C+2, and so on, we should f 
read K—1, K, K-+-1, K-+2, ete. 
‘ The admixture of causes of error (A and B causes) to causes 
F of the true facts (AB causes) increases the variability of the 
d distributions, this being the effect discussed by Thorndike* and 


by Kelley.* It lowers the correlation, this being the attenuation 
discovered and fully described by Spearman.* It may als 
change the form of the distribution and change the form of the 
relation line. Thus if the error increases in relation to the magni- 
tude, the distribution of the imperfectly measured fact will, 
ther things being equal, take on skew (or more skew, if 
perfectly measured fact had some in the same direction), all « 
the arrays save the extremes will take on skew, and the rela- 
tion line will take on bend (or more bend if it was originally 
bent in the same direction ).° 

Corrections for the effect of errors of certain type in in- 
creasing variability have been worked out by Kelley; correc- 
tions for their effects in reducing correlation coefficients hav: 


been worked out by Spearman; and corrections for the effect 





errors related in magnitude to the magnitude of the fact 
ing skewness to distributions and bending relation lines 


probably be worked out also. I am, however, convinced 


? Thorndike, E. L. Introduction to the theory of n t 
easurements, New York: The Science Press, 1913, p. 93. 
* Kelley, T. L. ‘‘The measurement of overlapping,’’ J l of I 
val Psychology, 10:458-461, November, 1919. 
‘Spearman, C. ‘‘ The proof and measurement of associat 
ings,’’ American Journal of Psychoload /, 15:72 101, Jar uary, 1904 G 
eral intelligence objectively determined and measured,’’ American J l 
Psychology, 15:201-92, April, 1904. 
*The skew or bend may of course counterbalance a skew or bi 
site sense and so give a spurious symmetry for a distribution that with perf 
measures would be skewed, or a spurious rectilinearity for a re 
with perfect measures would be curved. 
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for most of our work we should try to reduce the magnitude of 
these errors at the outset, as well as to correct faithfully for such 
as remain. At the present time more work is being done prob- 
ably with measures whose self-correlation in the group in ques- 
tion is under 0.80 than with measures whose self-correlation is 
over 0.80. 

Such measures do not allow anything like accurate location 
of an individual, and require elaborate correction to reach cor- 
rect ideas about the form of distribution of the group, the nature 
and amount of overlapping between groups, the amount of corre 
lation, and the form of the relation line. We do not yet even 
know how to make some of these corrections. It seems, there- 
fore, the part of wisdom to make much more adequate original 


measures than it has been our custom to make. 
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\N EXPERIMENT TO DETERMINE THE EFFECTIVE- 
NESS OF PRACTICE TESTS IN TEACHING 
BEGINNING READING 
Nita BANTON SMITH 
Assistant Supervisor of Primary Grades, Detroit, Michigan 


During this period of reconstruction, there probably is no 
other subject in the school curriculum which is receiving such 
widespread and concentrated attention as reading. Since it is 
generally conceded that reading is the most important of the 
school arts, that it is the master key with which we unlock the 
gateway to every other subject, it is small wonder that reading 
has been the target for such universal investigation. These 
scientific studies, resulting in valuable contributions to the 
teacher, have been carried on by many competent people in all 
parts of the country. They have extended over a very long 
period of time and have covered all stages of reading develop- 
ment. Asa result we have accumulated a great body of scientific 
knowledge in which the process of learning to read has been 
analyzed into its elements and the laws governing the successful 
teaching of reading have been clearly formulated. 

By combining the most significant of these contributions with 
i vast amount of experimental data accumulated while attempting 
to develop practice tests in reading, it was possible to set up 
certain definite aims or objectives which it seemed highly de- 
sirable to embody and combine in a complete new method for 
teaching beginning reading to first-grade children. The most 
important of these aims were: 

1. To develop the child’s power to purpose through the use 

of reading situations. 

2. To enable him to use his reading ability as a tool in carry- 
ing out his purpose from the time of his first contact with 
the reading activity. 

To provide some means whereby the child may largely 


w 


teach himself in learning to read. 
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4. To permit each child to progress as rapidly as his indi- 
vidual effort and ability will permit. 


It might be said that there were at least a score of other aims 
which were constantly kept in mind throughout the preparation 
of the material. But the ones mentioned above, “purposing,” 
“reading as a tool,” “self-helpfulness,” and “individual progres- 
sion,” were the four corner-stones upon which the framework of 


the Practice Tests was built. 


DESCRIPTION OF MATERIAL 

The materials developed to meet these aims consisted of 
several different pieces. In the account below each of the pieces 
needed for one complete lesson is described, the sequence of the 
steps of procedure is shown, and the use to which each piece of 
material was put is explained. 

r. Picture Frame.—The child is first provided with a picture 
frame on which is printed a background, but in which the im 
portant objects are omitted and in their places are printed thei: 


names. 
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FIGURE 1. PICTURE FRAME 
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2. “Cut-outs.”’—The child is next given a sheet on which are 


rinted these missing objects which are to be cut out, col red, and 
pasted on the frame to make the completed picture. 
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e cake ice-cream 
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FIGURE 2. “CUT-OUTS” 
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It is reasonably safe to assume that in every little child ther 
exists an innate love for cutting, coloring, and pasting. In_the 
Practice Test Material this instinctive tendency is taken advan 
tage of in developing the child’s purpose to read. When he sees 
the frame and the cut-outs arrayed before him there is aroused 
within him the desire to construct the completed picture and he 
is willing to carry on any activity which will aid him in attaining 
this end. In this particular case the activity involved is learning 
to read a set of directions in which he is given instructions for 
cutting, coloring, and placing the various figures in the frame 

3. Book of Directions.—The directions needed in building wy 
the pictures are given in a little book called the “Book of Dire 
tions.”” The directions for arranging this picture taken fro 


pages 20 and 21 are as follows: 


Cut the ill Paste the girls in the tra 

( out the ead where you see girls 

( t c-C1 Paste the boys 1n the f1 ‘ 

f t tn cand whe 11 see | S 

( 1 ‘ “ake t ‘ 4 ‘ I 

Cu hab where u see tabl 

Cut « the 4 het Paste the c ‘vy on the table 
where you see cand) 

Do not color the table Paste the ic cream 

1) ( the g1 on the tabl 

|) color the boys where you sce ice-cre 

Color the cat ly red Paste the cake on the tabl 

Do not color the milk where you see cake. 

Color the bread brow: Paste the bread 

Do not color the ice-cream on the little tabl 

Color the cake brown where you see bread 

Do not color the bab Paste the milk 

Do not color the mother on the little tabl 


= - . , SIL 
where you see milk. 


The child’s motive in reading these directions is analogous 
to that of the soldier of fortune in the conventional treasur« 
island stories, who learns that gold is buried in a certain area 
Some dying man whom he has befriended hands him a cod 


which shows the exact location of the treasure. He cannot find 


it, however, until he is able to decipher the cryptic directions 

















ch, 1923 PRACTICE TESTS IN TEACHING READING 217 


Hence he has a powerful motive for learning to read the mys- 
erious symbols. The new words involved in each new set of 
directions are symbols which are probably as mysterious to the 
little child as were the ciphers in the code of the soldier of for 
tune. How is he going to find out what these new words are so 
that he may carry out the directions for making his picture? It 
is not necessary for him to wait until the teacher develops the 


vords and gives the whole class drill upon them. He may find 


them out for himself just as rapidly as he cares to look them up. 


Lesson 8 Lesson 8 
GQ 
Ds 
77, \ 
04 / 
tattle “T 
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FIGURE 3. THE “DICTIONARY” 
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4. Dictionary.—As a reference for looking up words, the 
child is furnished a “Dictionary” in which all new words needed 
are pictured in such a way that he may find them for himself by 
matching the unrecognized word with the same word in the 
dictionary and looking at the picture above it. 

5. Story Sheet—Upon completing his picture the child is 
given a loose-leaf sheet on which is printed a small replica of the 
picture he has made together with a story about the picture 
which involves all the new words which he has been teaching 
himself while building the picture. 

The small reproduction of the completed picture furnishes 
the child with a standard whereby he may judge of the success 
or failure of his work. He compares his product with this on 
and if the two are exactly alike he knows that he has carried 
out the directions correctly. In other words he has a means of 
checking up his own comprehension. _ If his picture is correct 
he then studies the story about the picture with reference to his 
dictionary, if necessary. When he feels that he is prepared, hx 
goes to the teacher and reads it aloud to her. This oral reading 
of the story is a test of the child’s ability to recognize the new 
words learned during the picture-building activity. 

6. Cover for Loose Leaf Sheets—The child has in his pos- 
session a cover called “My Story Book” in which he files away 
his story sheets as rapidly as he is able to earn them. The 
number of pages contained in this book at any time is a measure 
of the child’s progress. The pupil himself takes very great 
interest in watching his story book grow in volume and it als 
furnishes tangible evidence whereby parents may constantly kee; 
themselves acquainted with the rate and content of their child’s 
progress. 

DESCRIPTION OF E.XPERIMENT 

This special type of reading was carried out with 180 begit 
ning first-grade children in Detroit schools during a period of 
five months, September, 1921 to February, 1922. Four schools 
of different types were selected as the field of experimentation— 


a platoon school attended by children from the best homes, 
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The cake, candy 
and ice-cream 
are on the big table. 


The bread and milk 
are on the little table. 


The boys are eating 
the ice-cream and cake. 


The girls are eating candy. 
Baby is crying. 
He cannot eat 

ice-cream and cake. 
Mother will give him bread 
and milk. 


FIGURE 4. STORY SHEET 
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plattoon school attended by children from middle-class homes, an 
ordinary type of school attended by children from middle-class 
homes and an ordinary type of school attended by foreign 
(Polish and Hungarian) children who, because of crowded con- 
ditions were limited to half-day sessions of work. 

In using this material the teacher was able to take full ad 
vantage of the “laws of learning.”” She placed emphasis upon 
purposing and self-teaching, rather than upon the mechanical 
aspects of reading. Whenever a pupil found himself in a crucial 
situation he asked and received help from the teacher, but th: 
real responsibility of his progress rested upon the child himsel! 
He worked largely under his own direction, teaching himself th« 
new words needed and learning to read in his own way according 
to the peculiar workings of his own mind 

For each group using the Practice Tests, a control grou 
using another method, was selected. In each case this contr 

roup was equivalent to the experimental group in the following 
respects: type of school, ability of teacher (as nearly as it is 
possible to judge), number, age, intelligence, nationality, pre 
vious training, tvpe of children, and the amount of time devoted 
to reading. 


Tr) 
i 


The Detroit Vocabulary Test was administered at the begi 
ning of the experiment to all children in both groups but fron 
1e total number only two pupils recognized any of the words 
The scores of these two were later discarded. It, therefore, 
seems safe to assume that all scores used in the tabulated results 
were those of children who started with zero ability in reading 

The teachers kept a record of the number of pages and books 
read by each individual throughout the semester. At the end of 
the time five standard reading tests were administered: Gray 
Oral Reading Test, Haggerty’s Tests 1 and 2, Detroit Group 
Vocabulary Test, and Detroit Story Picture Test 

\fter tabulating the results from the total number of pupils 
to obtain some general data, the individual children in the tw 


groups were matched according to age and intelligence, that is 


the scores earned by a child in the experimental group who was 
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x years and three months old and had an intelligence rating of 
\ were matched with the scores of a child of same age and in- 
elligence in the control group. All cases which could not be 
atched were discarded and the total matched cases of each 
group were combined to form the two exactly equivalent groups 
one, the experimental, and the other, the control. 
All charts shown were based upon data obtained from the 
results of these two exactly equivalent groups. Figure 5 shows 
the median scores resulting from the administration of the stand- 


ird reading tests to the two matched groups. 


END OF 20 WEEKS 


GRAY VOCADULAY _ 
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FIGURE 5. SHOWING THE MEDIAN SCORES ON THE STANDARD 














READING TESTS GIVEN FO TWO MATCHED GROUPS 


In the Gray Oral Reading Test, the median score of the Ex- 


perimental Group was 42.5 which is only 0.5 of a point below the 


standard for the grade 11-A. The Control Group made no score 
this test. 

In the Group Vocabulary Test the Experimental Group 

rned a median score of 27.6. There is no standard for the 

vrade u-A in this test, but pupils using the Practice Tests ex 

eded the 11-B standard to such an extent that it seems sate to 


ssume that they attained a 11-a standard. The median score of 


the Control Group, for whose reading vocabulary the test had 
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previously been designed, was 16.8, which is slightly above the 
I-B standard and which indicates that they were a perfectly nor- 
mal group. 

In Haggerty’s Test 1, the Experimental Group earned a 
median score of 4.8 which is above the 1-a standard of 4. The 
median score of the control group on this test was 1.1. 

In Haggerty’s Test 2, the Experimental Group made a median 
score of 4.4 which is 2.4 points above the standard for the I-A 
grade. The Control Group made a median score of 1.8 in this 
test 

In the Story Picture Test the Experimental Group made a 
median score of 3.3 which is 2.5 above the standard for the 1-s 
grade. There is no l1-a standard for this test at the present time 
but again it is safe to assume that the Experimental Group at- 
tained or exceeded the 11-a standard. The Control Group earned 
a median score of 1.2 which is the standard for the I-B grade 

The most significant fact to be gleaned from this chart is 
that in the most of the tests the 1-8 children using the Practice 
Tests made a median score at the end of five months which was 
equivalent to the 11-A standard or the standard of children who 
had been reading for two years. 

Figure 6 shows the median number of books read by each 
group in each level of intelligence. The numbers on the vertical 
scale denote the number of books read, while the horizontal 
scale denotes the different levels of intelligence. As is to be 
expected, in both cases, the median number of books read by 
the children of D and C intelligence was lower than that of the 
children of B and A intelligence. 

In every instance, however, the median number of the books 
read by the Experimental Group was decidedly higher than that 
of the Control Group, the range in the latter group being from 


one book in the group of D intelligence to two and one-half books 


ne g 
in the group of A intelligence, while in the Experimental Group 
the range of medians ran from four books read by children of D 
intelligence to eleven books read by children of A intelligence. 
The most striking fact which the chart reveals is that the 


children in the lower quartile of the Experimental Group achieved 
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vastly more in the amount of material read, than did those in the 
upper quartile of the Control Group, the upper quartile of the 


pupils of D intelligence in the Control Group falling at 1.2 while 


the lower quartile of the pupils of the same intelligence in the 
[Experimental Group fell at 3.5. A similar relation exists between 
these two quartiles throughout all the different levels of intelli- 
ence reaching the greatest divergence in the groups of A intelli- 
vence at which point the upper quartile of the Control Group falls 
t 2.7 books while the lower quartiles of the Experimental Group 


falls at 7.25 books. 
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IGURE O. SHOWING THE MEDIAN NUMBER OF BOOKS READ BY 
EACH GROUP IN EACH LEVEL OF INTELLIGENCE 


All first-grade children in Detroit are tested by the Detroit 
Group Intelligence Test and given one of the grades: A, B, C+, 
C, C—, D, or E. A is the grade given to children testing the 


>? 
>s 


highest, and Eto those testing the lowest. The A’s and 
ire then plaeéd together in one group called X’s; the C-+-’s, C’s, 
nd C—’s are placed together in a group called Y's; 
D’s and E’s are placed together in a group called Z’s. Thus the 
letter X is used to designate the group having the highest level 


and the 














224 JOURNAL OF EDUCATIONAL RESEARCH Vol. 7, No.. 


of intelligence; Y, the group of average intelligence; and Z, the 


children below average intelligence. 


Figures 8, and g show the distribution of the number: 


ind erade ( primer, first or second readers ) of books read by 
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BY MATCHED GROUPS OF Z INTELLIGENCE 


atched groups of the > a  ? and Z levels of intelligence In 
ach of these figures the numbers on the vertical axis represent 
the number of books read, while those on the horizontal axis 
represent the number of matched pupils. The large black letter 
represents the intelligence rating of the group charted. The 
heavy line at the top of the chart shows the total number of 
oks read by the pupils in the Experimental Group, while the 
line which marks the top of the blackened portion of the chart 
hows the total number of books read by the matched cases 1n the 
Control Group. The black and white surfaces represent primers 
read, the portion shaded with the oblique lines represents first 
readers read, and that shaded by the crossed lines represents 
cond readers. Thus pupil Number 1 of X intelligence in the 
xperimental Group read 16 primers, 14 first readers, and 2 sec 
nd readers; while pupil Number 1 in the Control Group, 
lthough of the same age and intelligence read but three primers 
luring the semester. The range of the Experimental Group ran 
rom 32 to 3 books, that of the Control from 4 t 
None of the children in the Y group read any second readers 


but many of those who used the Practice Tests read several first 
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readers. The range in the Experimental Group ran from twenty 
to two books read while that in the Control Group ran from two 
and one-half to three-fourths of a book read. 

The children of Z intelligence read only primers in both cases 
but the number of primers read by the Experimental Group was 
much higher than that of the Control Group, ranging from 7 to 
2 in the Experimental Group against one to three-fourths in the 
Control Group. 

In no case did the teacher urge the child to read more books. 
Whatever was accomplished was done at the behest of the child's 
own “inner urge.” In every instance, it is evident that in so far 
as achievement in reading is marked by the amount of material 
read, the children using the Practice Tests excelled by a wide 
margin. 

Another significant feature to be noted is the wide variation 
in achievement which exists among the children of the same 
level of intelligence, when allowed to progress individually. To 
take the children of X intelligence, for instance; when obliged 
to follow the conventional classroom procedure, it will be seen 
that they all cover about the same amount of material during the 
term, but when allowed to progress according to their individual 
effort and ability, it will be noted that there are some “X’s” who 
forge ahead reading as many as thirty or thirty-two books dur- 
ing the term while there are still others of this same level of 
intelligence who only read four or five books. This is not as 
high a number as that read by some of the children of Y or 
even Z intelligence. This evidence of the wide variation in the 
achievement of members of the same level of intelligence, and of 
the overlapping of the achievement of the members of different 
levels of intelligence, has been reproduced again and again in 
this and other experiments and constitutes one of the most con- 


vincing arguments for individual instruction. 


SUMMARY 


Every one affected by this experiment seemed very well 


satisfied throughout the duration of its term. Parents were de- 
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lighted because their children were making such excellent prog- 
ress; teachers were greatly pleased because they were convinced 
of the advantages of the method, and also because they were 
relieved of that everlasting ““bugbear”’ of the first-grade teacher’s 
life—“trying to find some seat work with which to keep the little 
mes busy’’—and above all the children were happy because they 
were doing something which they wanted to do. Learning to 
read to them was certainly not “the scourge of infancy” as Ros- 
seau once called it. To them it was a pleasure-giving and self- 
satisfying activity, the outgrowth of engaging in a pastime which 
had proved fascinating to little children ever since scissors and 
crayons were invented. 

To sum up briefly the results of this experiment would indi- 
cate that with enough of this material to last throughout the 
semester, the Practice Tests in Reading might be expected to 
save at least two years in the child’s reading life. There are two 
reasons, however, why it seems best not to use this data as final 
in drawing so important a conclusion: first, since this experi- 
mental material was only used in four schools, perhaps the num- 
ber of cases is not large enough to be reliable, and second, since 
teachers in an experiment usually have special advantages in the 
way of contact with the supervisor. Since teachers often take a 
keener interest and put forth greater effort when trying out new 
material under experimental conditions, it 1s possible that they 
obtained better results than the teacher under ordinary circum- 
stances would do. So for the time being it seems best to be 
conservative and say that with the use of the Practice Tests in 
Reading the beginning first-grade child of average tintelligen 
may be expected to read as well at the end of one semester as he 
has previously done at the end of one year. 

The essence of the entire experiment is embodied in a quota- 
tion from Mr. S. A. Courtis, Director of Instruction in Detroit 
Public Schools, under whose direction the Practice Tests in 
Reading were developed. They are but one expression of the 


general policy for which Mr. Courtis stands in Detroit and the 


writer had the benefit of his most excellent criticism and guid- 








ne en 





control of that most important of the school arts, the ability to read.” 
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ance throughout the preparation of the material. Mr. Courtis 


Says: 


‘Purpose is the key which unlocks every educational difficulty. So 


important is purpose that the best modern definition of educatior 
] } if 


aecscripes 


as growth in power to form worthy purposes and to achiev: 


[his means that in teaching reading, the best results will be ol 


ed, not by the teacher who works for results in reading, but by the 
; ~} h ] 


teacher who sees in reading situations a new field in which to give her 


children experience in ‘purposing’ and ‘achieving’ and who develops 


power to purpos¢ ts letting the re ading results take care of themselves 


[he teacher, who in the spirit of service directs her efforts towar 
helping children carry out their own purposes in picture building a1 
reading, will not only have the satisfaction of seeing her charges grow 
personality, character, and intellectual power, but to these product 


which are the essentials of all true teaching, will find added as a >) 


product that thing for which she did not work, namely understandin; 











INTELLIGENCE LEVELS AMONG STATE NORMAL- 
SCHOOL GRADUATES 


0 FREDERICK L. WHITNEY 
State Teache rs College, Moorhead, Mir nesota 





To a certain degree popular opinion has placed the elementary 
eachers in our public school systems on rather a low level of 
e intelligence, and this opinion has seemed to be supported by the 
findings of a number of investigators who have reported since 
the World War.' The present inquiry deals with a sampling 
of that part of the teaching population which has graduated from 
state normal schools, and the results obtained point to the neces- 
sity of a revision of this opinion, at least as far as that part of 
the teaching population is concerned. This revision may be 
established as a proven fact by further study. 

The graduates of the state normal schools constitute the ele- 
mentary teaching corps in our larger school systems. This 
group, which comprises about one-fifth of the teachers of the 
country, has benefited from the definite attempt of the various 
: states to give an adequate preparation for teaching in the public 
schools. If the state normal schools are admitting individuals 
of low mentality, there is grave danger that the objectives of 
public education may be defeated and that standards of the teach 
ing profession may become debased. A number of tentative 
answers appear to the question, What levels of intelligence, as 
measured by accepted tests, are found among elementary teachers 


in our larger cities? 


INTELLIGENCE LEVELS IN COLLEGE AND IN STATI 
NorRMAL-ScHoot GROUPS 


The army tests were given to a group of 780 second-year 


students in eight state normal schools. The median score of 135 


Yoakum, C. S., and Yerkes, R. M., Army mental tests. New York: 
Henry Holt Company, 1920. 330 pp. Yerkes, R. M., ed Psychological exan 
ming tn the United States Army, (Memoirs of the National Acaden \ of 
Sciences, Vol. XV), Washington, D. C.: Government Printing Office, 1921 
890 pp. Gambrill, Bessie L., ‘‘Some administrative uses of intelligence test 

state normal schools.’’ Twenty-first Yearbook of the National Society for 
the Study of Education, 1922. pp. 223-45. 
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secured by this group may be compared with medians obtained 
by Van Wagenen from an examination of 887 freshmen at th 
University of Minnesota.*, Using Form 6 of the Army Group 
Examination Alpha for eight of the university colleges he 
obtained the median scores given in Table I. The figures in 
parenthesis represent the medians stepped up to the amount of 
about eight points. The state normal-school students were ad- 
vanced two years beyond the high school, while the college fresh- | 
men were but one. Detailed examination of levels of alpha | 
intelligence found in groups at various stages of advancement 
from freshmen high school to graduate university seems to show 
increases of from five to ten points for each year.* 


TABLE I. MEDIANS OBTAINED BY THE STUDENTS OF EIGHT 
COLLEGES AT THE UNIVERSITY OF MINNESOTA 


Home Economics 
Dentistry 


Colleges Medians 
Chemistry. 154.2 (162) 
Arts men 133.3 (141) 
Pharmacy 132.6 (140) 
Engineering 131.6 (129) 
Agriculture 130.0 (138) 
Arts women 129.2 (137) 

121 
l 


20.5 (128) 
2 (121) 


The central tendency of the eight college medians is prac 
tically the same as that found in the eight state normal schools 
A further confirmation of these facts is found in Table I] 
in which are compared the medians for university and colleg 
students reported by a number of investigators* and the results 


7 Van Wagenen, M. J., ‘‘Some results and inferences derived from the us 


of the army tests at the University of Minnesota,’’ Journal of Applied Psy 
chology, 4:59-72, March, 1920. 


*Van Wagenen, M. J., ‘‘Our schools as measured by the army tests.’’ 
Educational Administration and Superviston, 5:163-76, April, 1919, and ‘‘ Has 
the college student reached his mental maturity when he enters college?’’ 


School and Society, 9 :663-66, May, 31, 1919. Yerkes, R. M. ed. Op. cit. PI 
544-46, 659-64. 


* Yoakum, D. S., and Yerkes, R. M., Op. cit. Brown, J. C., and Maxwell 
G. E., ‘‘ Intelligence of normal school students,’’ National School Digest, 39:23, 
May-June, 1920. Reeder, R. C., ‘‘ Application of army mental tests,’’ Nation 
School Digest, 40:357-59, February, 1921. 
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tained from the eight state normal schools. Here the central tendencies 
at the for college groups seem to be from ten to fifteen points higher 
Grou 1an those for state normal-school groups without accounting 
zes hy for any discrepancy which may be due to differences in stages of 
ires 11 dvancement. But, since the groups are such indefinite mixtures 
unt of the influence of this factor cannot be determined accurately 
re ad [he comparison of single figures for such distributions as these 
fresh- not very profitable but the proportion of “A,” and of “A” and 
alpha “B” scores gives a better expression of the real differences 


‘ement 
) show BLE Il 4 COMPARISON OF THE INTELLIGENCE SCORES AND 
CLASS RATINGS OBTAINED BY COLLEGE AND NORMAL 
SCHOOL STUDENTS 
,HT 


Percent Percent 








Median | of “A ofA 
and “B 
scores 
scores 
Universities 135 17 +] 
State Normal Schools 134 50 17 
College Students 130 10 75 
State Normal School Students 122 15 77 
College Men 130 +] 74 
State Normal School Men 115 23 63 
College Women 127 38 75 
pra State Normal Sx hool Women 117 0 75 
lOO! 
le I] On the whole, no very great discrepancies appear except in 
I] the case of “A” scores gained by the two men’s and the tw 
11eg - 
+ men’s groups. Here, the college men seem to have a dis 
ct advantage. 
he 1 
iP. . : : : 
COLLEGE OF EDUCATION STUDENTS FROM LINIVERSITY COLLEGES 
ete. ?? AND FROM STATE NORMAL SCHOOLS 
‘H 
get \ comparison of alpha levels in the case of the same group 
t. pr 
f 780 state normal-school second-year students and of 150 
xwel junior and senior students in a college of education gives the 
Viz ‘ . 
‘io results shown in Table ILI. 
Pe) 





| 
| 











ons ee 


| 
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TABLE Ill. ALPHA LEVELS OF STATE NORMAL-SCHOOL STUDENTS 
AND OF JUNIORS AND SENIORS IN COLLEGES OF EDUCATION 


| College of State Normal 


| 
| 
| 
| 








Education School 
Median | 152 135 
Q, | 166 149 
Q: | 138 114 
Q | 4.2 | 17.5 
N 150 780 





Thirty percent of the group of 150 are former state normal- 
school students. It will be recognized that this college group 
is probably the more highly selected, since they are advanced 
three and four years beyond the secondary school, while the 
group of 780 are but two years in advance. If an allowance of 
eight points be made here for selection or growth or some other 
determining factor, on the assumption that the college of educa- 
tion group were all seniors, the central tendencies would be iden- 
tical. It will be noticed also that selection narrows the spread of 
the two distributions for Q, the quartile deviation, is smaller for 
the college of education group. The approximate identity of 
central tendencies is confirmed by a measurement of the intelli 
gence of a group of 300 juniors in colleges of education by th 
Miller Mental Ability Test. The results of this measurement 
are given in Table IV according to the types of institutions whic! 
the students had previously attended. The figures for those wh 
entered from other university colleges are very similar to those 
for students entering from state normal schools. 

One hundred of these college of education students wer: 
checked by “honor points” earned during the two years of pro 


TABLE IV. INTELLIGENCE OF JUNIORS IN COLLEGES OF 
EDUCATION 





From From 
| University | State Normal 
Colleges Schools 
Median | 97 96 
Q: 88 Si 
Q; 104 101 
N 223 67 
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fessional work in the university. The average number of honor 
points per credit hour was computed—an “A” being given three 
honor points; a “B,” two; and a “C,” one. It was found that 
former state normal-school students received more honor points 
in both academic and professional subjects. These facts are 
summarized in Table V. 


TABLE V. HONOR POINTS EARNED BY JUNIORS IN COLLEGES 
OF EDUCATION 


. Academic subjects: | Education subjects: 
Students entering : J 2 oy 


: . Honor points per Honor points per 
from: ae # 
credit hour credit hour 
| 
College of . 
Science, Literature, 
and Arts.... 1.49 1.34 
Minnesota State 
Normal Schools 1.57 1.60 


While this is not a measure of intelligence like Army Alpha, 
it may be that it takes account of larger amounts of influence 
coming from character traits and is, therefore, a better index for 

tal mentality. 


OccUPATION LEVEL OF ELEMENTARY TEACHING 


How does the intelligence of state normal-school graduates 
compare with intelligence levels in other professional and occu 
pational groups? The Alpha scores obtained in the army have 
been tabulated by occupations,® and our state normal-school 
zroup may be placed here at its corresponding level 

First, however, it is interesting to note that on the basis of a 
distribution of scores according to the army literal notation, 
there is a close similarity between the standing of the 78o state 
normal-school graduates and the standing of army captains 
Table VI brings these figures together. It also shows the dis- 
tribution for 94,000 individuals of the white draft. The reader 


* Yoakum, C. S., and Yerkes, R. M., Op. cit. p. 38. 
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TABLE VI COMPARISON BETWEEN NORMAL-SCHOOL GRADUATES, 
ARMY CAPTAINS, AND THE WHITE DRAFT 


one State Normal Army White 

: School Captains Draft 
A 17.4 53.4 4.1 
B 38.2 29.0 8.0 
C+ 14.2 14.4 15.2 
( 0.2 3.8 25.0 
C— 0.0 0.4 23.8 
D 0.0 0.0 17.0 
D— 0.0 0.0 oe 
N 780 3,023 94.004 


will note that only 0.2 percent of the normal-school graduates 
fell below C 

If one uses the occupational ladder furnished by Yoakum an 
Yerkes, these literal groups appear as follows: “A” students, 
47 percent of all, are on an intellectual level as high as or highe1 
than the median engineer. “B” students, 38 percent of all, ai 
on an intellectual level as high as or higher than the media 
physician, accountant, draftsman, dentist. “C” students, 14 per 
cent of all, are on an intellectual level as high as or higher thar 
the median bookkeeper, nurse, clerk, telegrapher, photographe 
storekeeper, worker in concrete 

That is, about half of this group of prospective elementary 
teachers are found on a level of intelligence equivalent to th 
of army engineers, another forty percent may be compared wit! 
physicians and dentists, while the remainder, the smallest part 
have literal ratings similar to those of bookkeepers, clerks, and 
skilled workmen 

The above facts, tentatively established, have many pra 
tical implications. Only two will be suggested here. From thi 
study it would seem that the teacher material from which ou 
state normal schools are making elementary teachers is ver) 
similar to that used by colleges of education in making secondary 
teachers. If so, this basis of essential equality may speed thi 
happy day when matters of professional equipment and of con 
pensation will be decided on grounds other than that of the ag 
of the pupil groups taught. 
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Further, it may be that a skillful organization and manage- 
ent of our school systems should make certain that the capa- 
bilities of the entire corps of employees be capitalized in many 
realms of activity which have been, through habit or tradition, 
specialized. In particular, there may be qualities of leader- 

lip among elementary teachers which have been neglected 


ider representation and fuller participation from this group 


‘i ~ | ui} 


will be safe, if it is finally determined that the intellectual levels 


\ 


tentatively established above are matters of real fa t. 


ADDENDUM 
\ recent survey of all (10) Massachusetts state normal 
hools—Kirkpatrick, E. A., “Intelligence tests in Massachu 


tts normal schools,” School and Society, 15 :55-60, January 14, 


g22—is, on the whole, confirmatory of the above statement 
Kirkpatrick includes Thurstone’s figures from Pennsylvania 
te normal schools and from thirty colleges, and says, ‘A larger 
ercent of low-grade students is found in the freshman classes 
lleges than in all classes in Massachusetts normal schools, 


lany of the low-grade college freshmen are doubtless eliminate¢ 


fore § etting into higher classes of college Colle ges have and 
coy S 


keep more brilliant students, yet between 80 and go percent ot 
students of colleges are of the same grade Ol intellige nee S 
found in the Massachusetts normal schools. This is quite 
ntrary to the claims sometimes made, that bright students g 

» colleges and dull ones to normal schools."” The writer used 
e Thorndike Intelligence Examination for high-school gradu 
with IOI seniors in an eastern state normal school and 


nd a median score of 63. Thorndike found—unpublished 


the median for freshmen home-economics women in 


estern colleges to be 59, for all freshmen in eastern liberal arts 
=) . 

lleges 73, for all classes in southern liberal arts colleges 66, 

r all colleges of ‘Type \’ 70, and ror all ct llege Ss Ol ‘Type 
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SPELLING AGE COMPUTED FROM THE SCORE ON 
FIFTY PERCENT LISTS 


WALTER E. MorGan’ 
Principal, Webster School, Fresno, California 


In a study of the accomplishment of school children, in which 
the quotient technique was used, it became necessary to deter- 
mine the spelling ages of pupils of the elementary grades. Age 
norms were available for such product tests as the Woody-McCall 
Mixed Fundamentals, the Trabue-Kelley Completion Test Exer- 
cises, the Thorndike Visual Vocabulary Scales,? and the Thorn- 
dike-McCall Reading Scales. In spelling, however, there were 
no age norms. It was, therefore, necessary either to establish 
them or to adopt some technique which would be equally valid in 
determining spelling age. 

Conversion of the grade norms for the fifty percent lists of 
the Buckingham Extension of the Ayres Spelling Scale into age 
norms, and the adaptation of Van Wagenen’s* Table I so as to 
determine, from the pupils’ scores on these lists, the point of 
fifty percent success and failure, would fulfill the need. 


AGE NORMS FOR THE GRADES 


After some search and communication some fifty thousand 
(50,456) pupils were located, distributed by ages as shown in 
Table I. The term ‘year’ signifies between nine and fifteen 
months, while ‘half-year’ means between three and nine months 
of age. Thus, in each case, the six-year group includes all pupils 
between five years nine months and six years three months of 


‘The author is indebted to Dr. Raymond H. Franzen for the suggestior 
of this technique. 

*These norms, together with derivatives thereof, will appear shortly in 
two publications: Franzen, R. H., The accomplishment ratio, (Teachers Col 
lege, Columbia University, Contributions to Education, No. 125.) New York: 
[eachers College, Columbia University; and Measurement of reorganization, 
edited by L. M. Terman, Chapter IV by R. H. Franzen, ‘‘The Conservation 
of Talent,’’ published by World Book Company, Yonkers, New York. 

*Van Wagenen, Marvin J., ‘‘ Table for computing mean individual scores 
in educational seales,’’ Teachers College Record, 21:432-40, November, 1920. 
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TABLE I. GRADE DISTRIBUTION AND MEAN AGES 


Number 
Grade of Mean Age 
Pupils 


). 24 


IB | 4687 6 
IA | 3516 7.04 
Ii B 3689 7.47 
II A 3289 8.12 
III B 3641 8 80 
III A 3214 9 33 
IV B 3357 9.73 
IV A 2873 10.18 
VB 3467 10 69 
VA 2870 11.41 
VIB 3170 11.8] 
VIA 2648 12.36 
VII B 2906 12.78 
VIIA 2594 13.01 
VIII B 2405 13.66 
VIII A 2130 14.12 
Total 50456 
ge; while the six and one-half year group includes those be- 
veen six years three months and six years nine months of age 


[he cities in which the pupils are located, and the number in each, 

Napa, California, 1,096; Butte, Montana, 6,232; Rock 

rd, Illinois, 6,928; Des Moines, lowa, 15,434; and St. Paul, 
linnesota, 20,766; total, 50,456 

When the average age for each yearly grade was obtained, it 

found that the mean increment of age was 1.0357 years 

his was then applied to grades beyond the eighth. The age 


s for all grades are indicated in Table I] 


TABLE II AGE NORMS, GRADES I TO XIl 


Ages 6.64'7 80:9 _ 0719 9611 05:12. _0912.90'13.89/14.93'115. 96/17. 00'18.038 
Having established age norms for the grades, the next step 
as to evolve or adapt a technique which 


no ve 
5 ag 








ween 





4 
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' 
GIVING THE TEsTs 
Grades Vi, vil, and vil were selected for the purpose 
establishing this technique. The method here given is, therefore, 
descriptive of the process used with these grades. It was e) 
tended, however, so as to render it usable with grades as k 
the second.* 
Ten words were selected at random from each of Lists R 
T, V, X, and Z of the Buckingham-Ayres Spelling Scale. Thes 
fifty percent lists for grades Iv, v, vi, vu, and vil. To tl 
eht words of List AB were added one word from each 
ists AA and AC, giving a fifty percent list of ten words t 
erade 1X These sixty words were then dictated, each w 
being repeated in a sentence or definition. Each list of ten w 
vas dictated separately, the pupils being instructed to place 
er literal designation at the head of each list 
When collected, the papers were rated by the examiner \] 
vords actually misspelled or omitted were marked by a chi 
the number of such misspelled or omitted words being placed 
the head of each list. Erasures or changes in spelling were 
considered errors 1f the last spelling was obviously correct 
COMPUTING SPELLING AGES 
In order to determine which would be the more econom 
administratively, two methods of scoring the tests and computi 
the spelling ages were used; that employed with the Trabu 
Nelley Completion Test Exercises for determining individual 
performance levels,” and that proposed by Van Wagenen as 
shorter way of accomplishing the same result The latter method | 
was finally adopted, since it eliminates a number of involved 
operations, which are time consuming and increase the prol 
ability Of errol 
Dr. ¢ C. RK . ipal Ur s I Sel 
( has « 1 this hniq grades I! 
s sts L, O, R, T, V und X Results w very satis t 
seco! gra here many pup failed mpletely to s 
st list of . 
K I Lee Indiv il testi v mpletion test ex 
Tea ( e Record, 17:371-82, September, 1917 
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Spelling age can be computed with considerable facility by 
mploying an adaptation of Van Wagenen’s Table I and using 
; Table II. Table I to which we refer is a table for calcu 
ting mean scores at the point where just fifty percent of the 
tasks are correctly done. It consists Ort scores, in terms ot the 
lificulties of the tasks performed, which correspond to any 
umber of errors, from one to ten, n ade at anv s¢ aie step, trom 
ne to fifteen, on an educational scale. Since, however, this tabl 
resents scores from performance at a given scale step, it 1s 
necessary to make correction for errors m less difficult scale 


teps. This is done by subtracting from the score obtained one 


/ 
/ 
f 


tenth the sum of the errors made on less difficu 


Wagenen’s Table II is a table of further corrections to be 


de when two or more errors are made on the /east difficult 

le step 

Since his Table I is in terms of whole-number scale steps 
equal intervals, and since the age values of the fifty percent 
ling lists are non-integral, with unequal intervals, it was 


ssary to adopt the Van Wagenen table in order to arrive 


pro} 


pe r scores 


lable III reproduces the section of his table which was used 
1 Table IV is the resulting adaptation. This was made fi: 
ibstituting for the “scale steps” (i.e., for 7, 8, 9, etc.) th 
ages already shown in Table I] eginning, | 
ean age (7.80) for the second grad The next stet 
ABLE ITI EXCERPT FROM VAN WAGENEN’S TABLE | 
Errors 
7 Ss 9 10 1] 12 l 14 
l 9.5 10.5 11.5 12.5 13.5 14.5 15 16.5 
Z 8 6 9 6 10.6 11.6 12 6 13 6 14 6 15 6 
3 $.2 9 2 10.2 11.2 12.2 13.2 14.2 15.2 
1 7 8 8 9 8 10.8 11.8 12 8 13.8 148 
5 7.5 8.5 9 5 10.5 11.5 12.5 13.5 14.5 
6 ¢.2 §.2 9.2 10.2 il.2 iZ.2 13.2 14.2 
7 7.0 8 0 901100) 11.0! 12.0)! 13.0 140 
s 65 78 & & 9 8 10 8 11 8 12. 8 13 8 
8) 6.6 7.6 8.6 9 6} 10.6 | 11.6 | 12.6 13.6 
10 6.5 7 5 QR 5 Qg 5 10.5 11.5 12 5 13.5 














o<metmen 
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adaptation consisted in adding to the entries in each column of 
Table III the difference between the scale step of Table III and 
the corresponding mean age of Table IV. 


TABLE IV. ADAPTATION OF TABLE III, FOR USE IN COMPUTING 
SPELLING AGE FROM SCORES ON THE FIFTY PERCENT LISTS 
JF THE BUCKINGHAM EXTENSION OF THE AYRES 
SPELLING SCALE 


List L | List O | List R | List T | List V | List X | List Z | List ABC 


Grade | Grade | Grade | Grade | Grade | Grade | Grade Grade 


— I] Ill IV V VI VII VIII | IX 
“s (Mean | (Mean | (Mean | (Mean | (Mean | (Mean | (Mean (Mean i 
age, age, age, age, age, age, age, age, 


7.80 9 07) 9.96 11.05) | 12.09) | 12.90) | 13.89) 14.93 


] 10.30 | 11.57 12. 46 | 13.55 4 59 | 15.40 | 16.39 17.43 
2 9. 40 10.67 11.56 12.65 13.69 14.50 15.49 16.53 
3 9.00 | 10.27 | 11.16 | 12.25 | 13.29 | 14.10 | 15.09 16.13 
i 8 60 9.87 | 10.76 | 11.85 | 12.89 | 13.70 | 14.69 15.73 
5 8.30 9.57 | 10.46 | 11.55 | 12.59 | 13.40 | 14.39 15.43 
6 8.00 9.27 | 10.18 | 11.25 | 12.29 | 13.10 | 14.09 15.13 
7 7.80 9 07 9.96 | 11.05 | 12.09 | 12.90 | 13.89 14.93 
8 7.60 8 87 9.76 | 10.85 | 11.89 | 12.70 | 13.69 14.73 
9 7.40 8 67 9 56 | 10.65 | 11.69 | 12.50 | 13.49 14.53 
10 7.30 8 57 9.46 | 10.55 | 11.59 | 12.40 | 13.39 14.43 


We have already referred to Van Wagenen’s Table II. As 


we have rearranged it, it is presented as Table V. 


TABLE V CORRECTIONS FOR ERRORS MADE ON THE LEAST 
DIFFICULT LIST OF WORDS 


Errors 9 8 é 6 o 4 s 3 2 


Add to amount to 
be subtracted 2.1}1.3]}1.0] .7 5 3 2 1 


By using Tables IV and V the process of obtaining spell 
ing ages is rendered extremely inlie The entire process 1s 
reduced to four or five steps, as follows: (1) add the num- 
ber of errors made on lists easier than the last (most difh 
cult) list of words attempted; (2) divide this sum by ten; 
(3) in case two or more errors are made on the easiest list at- 
tempted, find in Table V the amount to be added to the quotient 


obtained in (2); (4) find in Table IV the interpolated Van 
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I Wagenen value corresponding to the number of errors made on 
id the last (most difficult) list of words attempted; (5) subtract 
from the interpolated V. W. value obtained in (4) either the 
quotient obtained in 2, or the sum obtained in 3. The remainder 

us s the spelling age. 

For the reader’s benefit a job analysis of the spelling age 
technique is here given, followed by a number of examples illus- 
trating the method used. 

n 
A Jos ANALYSIS FOR COMPUTING SPELLING AGI 
Instructions for Giving the Test 
From the Buckingham Extension of the Ayres Spelling Scale 
random ten words from each of the columns L, O, R, T, V, 
X, Z, and to the eight words in column AB add one word from each 
he columns AA and AC. If the test is for no grade higher than the 
columns L, O, R, T, V, and X are sufficient. When the Ayres 
t is used in this latter case, to the eight words in Column X add one 
1 from each of the columns W and Y. 
2. Distribute ordinary spelling paper and use pen and ink ill 
where the pupils are accustomed to writing with ink 
Have the pupils place at the top of the papers the following 
1. Name; 2. Date; 3. Grade; 4. Age in years and months 
~ est 15 days). 

4. Dictate the words in lists of ten each, the easiest list first, being 

» have the pupils head each list with its proper literal designation 
eat each word in a sentence or in a definition, in order to obviate 
usion of similar words. 

[f Grades 111 to vi are being tested, use the list of ten words fro1 

lumns L, O, R, T, V, and X only. lf Grades vi to vir are being 

l, start with column R. This will minimize considerably the giving 

scoring of the tests and will be found thoroughly sufficient 

Collect papers immediately after completing the dictatior 
Instructions for Scoring the Papers 
. 1. The teacher should score all papers, using great care in mark 
nd computing results. This will insure her greater help when she 
to use the final results to improve pupils’ spelling 

2 Mark each word omitted or misspelled by a che 

If in the teacher’s judgment the final spelling the wv 1 wa 
rect, consider it so. Do not consider changes or erasures as errol 
the final product is a correct spelling 

| 4. At the head of each list of ten words, write the total number of 
words misspelled or omitted from that list 
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ns for ( mputing S pe ng 1 Ue 
Add the total number of errors a1 1 omissions (see instruct 
j ts ¢ ept empted 
) ‘ Ss te } (p e t e left 
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le t] : ; 
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List oO \ X Z ABC 


, Pupil 2 made the following errors 
Errors 0 l 2 7 8) 10 
pt Then, using the same method 
Pp 2), I [The number of errors made on lists « er than AR 
O tenth of 19 is 1.9 
No errors were ide in List R 


The spelling-age technique as given in this article was evolved 


ABI use in grades six, seven, and eight. It may be used, however 
grade for which there is a fifty-percent list in the Buck 

’ ngham-Ayres Spelling Scale; namely, with grades 11 to vil 
giving the lists to any grade or grades, it 1s advisable to give 


ugh lists to test thoroughly the abilities of all the childre 
Words should be given which as nearly as possible will result 
perfect scores on the easiest lists and zero scores on the n St 
ilt lists. If the children are well-classified, three lists should 

ice for any one grade; the fifty-percent list for the grade 
ested, and the fifty-percent list for the grades immediately above 


nd below it 


. Bi 








A CONTROLLED EXPERIMENT TO DETERMINE THE 
EXTENT TO WHICH LATIN CAN FUNCTION IN 
THE SPELLING OF ENGLISH WORDS 
WARREN W. COXE 
Ohio State University 

One of the problems which is being investigated by the Ad- 
visory Committee of the American Classical League in connec- 
tion with the Classical Investigation is the influence of the study 
of Latin on the ability of pupils to spell English words. The 
investigation of this problem aims, first, to discover to what 
extent, if any, the study of Latin contributes to the pupil’s ability 
in English spelling under present conditions of teaching Latin, 
and second, to determine under what conditions the greatest 
achievement can be obtained. 

The investigation follows two lines: a general survey, par- 


ticipated in by about 125 schools from all parts of the country, 


in which the relative gains of Latin and of non-Latin pupils in 
spelling will be measured; and a controlled experiment, in which 


the conditions of transfer will be studied more in detail. 

The controlled experiment is being carried on by the writer 
under the supervision of Dr. B. R. Buckingham, director of the 
Bureau of Educational Research of Ohio State University 
Four schools in Rochester, New York, involving about 1400 
pupils, and ten schools in Columbus, Ohio, involving about 1200 
pupils, are cooperating. 

The controlled experiment was begun in November, 1922, 
and will continue till May, 1923. It will use both Latin and 
non-Latin pupils from grades in which Latin instruction is begun 
In some of the schools, Latin is begun in the seventh grade and 
in others in the ninth grade. 

Five groups of classes are being used, each pursuing a dif- 
ferent type of instruction. They are as follows: 

Group I. Latin Control Group.—Classes in beginning Latin 
which will take the tests but otherwise pursue the ordinary course 
of study, making no effort to relate the Latin to English spelling. 
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Group II. Latin Experimental Group Alpha.—Classes in 
beginning Latin which will take the tests and follow a prescribed 
course of training. Each week of the training period, five Eng- 
lish words will be taught. The teacher is to point out the rela- 
tion of the Latin root to the English spelling, but is warned not 
to develop principles or rules. 

Group III. Latin Experimental Group Beta.—Classes in be- 
cinning Latin which will take the tests and use the same material 
is that given to Group II, but will develop principles. In the 
instructions to the teachers, seven rules are listed, which she is 

develop in class. The first rule is: Double consonants in 
Latin words are retained in the English derivatives, except at 
the end of compounds. Example: the “r’ is doubled in currere, 
consequently it is doubled in occurrence, but it is not doubled in 

ccur, 

Group IV. English Control Group.—This group is com- 
posed of English (non-Latin) classes of the same grade as the 
beginning Latin classes with which they are to be compared. 
They will take the tests, but will do nothing in spelling except 


such work as is ordinarily included in the course. 


Group V. English Experimental Group.—These classes are 


chosen in the same way that classes for Group IV are chosen. 
; I 


[hey will have definite instruction in spelling and will use the 
same words for practice material as are prescribed for the ex 
perimental Latin classes. 

To measure the relative gains made by these five types of 
classes, two tests have been devised: the Buckingham-Coxe 
Spelling Test and an Ungraded Test. The first consists of fifty 
words of known difficulty, half of which are from Latin roots 
and the other half from non-Latin roots. Of the twenty-five 
trom Latin roots, ten are from Latin words found in Henmon’s 
Latin Vocabulary,’ a list of Latin words common to thirteen 


first-year texts. The other fifteen are from Latin words found 


*Henmon, V. A. C. ‘‘The measurement of ability in Latin.’’ Journal of 
Educational Psychology, 13:515-38, November, 1917. 
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later in the high-school course, according to the Lodge? list 
There will be three forms of this test, each comprising a different 
set of equally difficult words. The first form, Form A, was given 
at the beginning of the experiment, Form B was given in Feb- 
ruary, 1923, and Form C will be given in May, 1923. 

The Ungraded Test is a supplement to the Buckingham-Cox« 
Spelling Test. It contains one hundred words, all of which are 
derived from Latin words found in the Henmon list. The diff 
culties of these words have not been determined, but those which 
were obviously easy to spell were not included. Half of the 
hundred words appear in the practice material which is used by 
the experimental classes, the other half are different. This test 
Was given at the beginning of the experiment and will be repeated 
in May, IQ23 There will probably be a practice effect due to 
having the same words repeated, but the gains due to this ought 
to be the same in all groups, and thus not destroy the possibility 
| compa®risons 

Following are some of the questions which it is hoped can 
be answered from the results of the experiment : 

To what extent is there an automatic transfer from th 

the spelling of English words? That is, when the rel: 

Latin to English spelling is not definitely pointed out, can 
ve be sure that a transfer will take place? 

2. When an effort is made to relate Latin to English spell 

what method of teaching is most effective? 


3. When the same effort 1s made to teach spelling in non 


Latin classes, how will the results compare with those obtained 


Latin classes 
[s increased ability to spell confined only to those words 
are taught, or does it spread to other words? 
Does the relating of Latin to English spelling result in 
nent only in words of Latin derivation; or is the trans 
* more general, resulting in gains in non-Latin words? 
ibulary of high-school Latin. (Columbia 


n, Teachers College Series, No. 9) New York: 


niversity, 1907. 217 pp. 

















LATIN AND ENGLISH SPELLING 


The first two questions relate primarily to the problem of 


he American Classical League’s investigation. Questions 3, 4, 
nd 5 are of vital interest and grow naturally out of the condi- 
tions set by the experiment. They are included in this study be- 
ise of the Committee’s intention to study related problems 
herever the data available lend themselves easily to the treat- 
nt of these problems. 
On the basis of the initial spelling test, pairs of pupils will 
e selected. That is, the gain of each pupil in Group I will be 
pared with the gain of a pupil in Group II who had the same 
nitial score in the spelling test. Following, are some of the 
uips which will be paired in this way. 
1. The Control Latin Group will be paired with each of the 
Experimental Latin Groups to determine whether spelling ability 
eased when Latin is related to English spelling. 
2. The Experimental Latin Group Alpha will be paired with 
Experimental Latin Group Beta to determine whether the 
f principles or rules results in any increased spelling ability 
The Control Latin Group and the Control English Group 
ll be paired to determine whether there is any automatic trans 
ier due to the teaching of Latin in the ordinary way. 
4. The Experimental English Group will be paired with 
h of the Experimental Latin Groups to determine whether as 
reat gains in spelling can be made in an English class as in 
tin class. 
5. Inasmuch as the teachers of the Experimental Latin 
\lpha classes are left more or less free to determine their own 
hods, it will probably be profitable to compare the efficiency 
the different methods, by pairing pupils and determining the 
ive gains. 
In addition to the determinations based on the pairings above 
entioned, some additional studies of the data may be made 
For example, intelligence ratings will be available for all pupils, 
1 it will be possible to determine whether gains are related 
ore closely to a general ability as measured by the intelligence 


test, or to a specific ability in spelling. 















Editorials 














“MORE THAN INFORMATION” 


The school has forgotten that personality is superior to in 
formation. School men today are facing the spectacle of 
great social agency whose chief efforts are directed upon th 
acquisition of information and skill. It is quite apparent that 
in this labor considerable progress and efficiency are in evidenc« 


In spite of the claims of critics of public education the develo 


Te 


ment of the technique of instruction has been remarkable during 
the last two decades. Information and skill are taught mor 
efficiently today than at any time in the past. 

If, however, we could choose or had to choose between 11 
formation or skill on the one hand and personality and char 
acter on the other, it is certain that we should select the latte: 
To be courteous, honest, and unselfish is better than to be erudite 


\ nation with fundamental traits of character well developed is 
much more secure in its future and happier in its present 
han is one which possesses the widest range of scien 


direct civilization and 


activities tf 
tific information. Ideals stabilize and 
whenever civilization declines and falls the fundamental caus 
Information is a servant 


lies in the disintegration of its ideals. 


of character and not a substitute. 
need to choose between informatio1 


Our problem today is not on 


Fortunately we do not 
We may have both 


and ideals 
1 alternative; it is merely a question of emphas! 


f choosing ar 


We can develop fundamental qualities of character and at th 


valuable information. Indeed without informa 


Ignorance has never been 
The highest 


same time give 


tion character cannot be strong. 


good matrix within which to develop personality. 
type of civilization is one in which fundamental traits of cha 
cter are served by exact and scientific information. 
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The school is at fault in laying the emphasis upon informa- 
Character is being developed but it is being done inci- 
ntally. The cause of this placing of emphasis lies in the cur- 


nt belief that ideals should be taught incidentally and not 
ystematically. Since it is not necessary to analyze character 
aits, to scrutinize them, and to weigh them, when they are 
ught incidentally; we do not analyze them. Because we do 
t have to list the traits, we let them grow according to nature. 
The result is that they are left to chance and accident. 
Nowhere within this nation of over a hundred million people can 
e find an authorative list of fundamental ideals. Individuals 
ve prepared more or less thoroughgoing lists but the attention 
the nation has not been turned upon the problem with suff- 
continuity and persistence to analyze the task and so we 

left in the dark. 
It is an obvious fact that if subject matter is not brought to 
nsciousness and placed in cold type in courses of study it will 
t receive adequate attention. When courses of study are filled 
with pages of material upon arithmetic, geography, and history 


nd no pages are devoted to ideals, it is inevitable that the major 





ttention of the teaching body will be placed upon material which 

they see in print. One of the laws of emphasis is emphasis by 

iss and where no space is given to an important subject it can- 

t possibly secure the attention which its importance demands 

The remedy lies in the recognition of those facts. The ideals 

be taught must be determined with the same care as the con- 

nt of arithmetic or spelling. The materials through which 

hey are to be taught must be given a prominent place in courses 

f study and textbooks. These ideals and the contributory 

iterial must be apportioned according to grades with due 

regard to initial instruction and secondary repetition and super- 
ision. Ideals must appear as topics in the course of study. 

Once this has been done they can be taught either incident- 

lly or formally depending upon the convictions of those who 


nstruct. Some people believe that systematic instruction in 





orals is a mistake. Others believe that it is necessary. If it 
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is taught systematically it is clear that the material must be 
worked out in systematic form. But it must be remembered 
that if ideals are taught incidentally they must still be worked out 
systematically for the guidance of the teachers who teach per- 
sonality by the incidental method. When it is taught formally 
it may be put into the hands of pupils. When it is taught inci- 
dentally the material must be put into the hands of teachers 
at least. 

The development of personality lends itself to as intensive 
culture as does any biological phenomenon. Domestication and 
culture tend to improve quality. This is a common fact of bio 
logical life. Equally is it true of personality. By isolating the 
traits of personality and concentrating upon their development 
it is possible to produce a development which is amazingly more 
rapid and efficient than natural unstimulated development can be 
Personality yields as freely to instruction as does information 
or skill. 

It is time for the schools to take stock of the situation and 
direct their attention and skill upon the development of per- 
sonality to the degree that character and ideals are superior in 


importance to information and skill. 


W. W. C. 
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*ARKHURST, HELEN. Education on the Dalton plan. New York: E. P. Dutton 


Company. 1922, 278 pp. 


At this period when the attention of educators is centered upon super- 
sed study, the socialized recitation, the project method, and scientific 
asurement, this new volume comes as a distinct contribution. 

rhe fact that the plan advocated has been successfully used both in this 
ntry and in England gives weight to its doctrines. The basic principle 
the Dalton Plan provides opportunity in the secondary schools and upper 
entary grades for pupils to initiate and organize their own procedure. 

a definite course of study is suggested, the methods of following it 

ik away from the traditional daily time schedule, the formal recitation, 
1 the time-honored examination. 
The entire year’s work in each subject is broken up into carefully gauged 
hly installments or projects, known as ‘‘ contract jobs’’ which the pupils 
to undertake. These monthly assignments are subdivided into weekly 
s, and the pupil is permitted to take these up in any order he chooses. 

rhe departmental plan is followed. The room for each subject is equipped 

needed apparatus and an abundant supply of departmental reference 
ks. The teacher in charge of the room is a specialist who teaches only 
subject. The pupil may go to the room set apart for the subject in 
*h he feels an interest, and work there as long as he wishes. Each pupil 
gets his own time. To prevent him from working too continuously on his 


orite subject he is not permitted to exceed its monthly prescription till he 


s completed the assignments in all other subjects. A pupil may do a week’s 


in one subject before proceeding to another. Interest in one subject 
| thereby, Miss Parkhurst thinks, spread to others less enjoyed. Before 


pupil leaves the work room he plots upon a graph sheet the amount of 
covered, so that he and the teacher can tell at a glance how much of 
wee kly assignment he has done. 
The Dalton plan also affords opportunity for helpful eooperation. The 
ls work in small groups helping each other and receiving such aid from 
teacher as occasion demands. The pupil thus forms the kind of relation 
ps in his school life that he will have later in business and professional 
erience. The teacher becomes a co-worker with the pupils. She gains 
intimate knowledge of their achievements that formal examinations are 
necessary. Her function is to supervise and guide the groups in their study. 
» recitation period is abolished and lessons are given only as progress in the 


ip may merit them. 
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Individual differences of the pupils are discovered through standardized 
mental tests, and the amount of work demanded from each is gauged by his 


mental ability. Each pupil is required to do the quantum and quality of worl 


commensurate with his intellectual capacity. In a period of one month th 


brighter pupils often do the work outlined for six weeks, while the less gifted 


may do only three weeks’ work. 

One of the most he Ipful chapters in the book is the one devoted to illus 
trative assignments. The book is so crowded with excellent suggestions that 
no teacher or supervisor can study the volume and incorporate its sane pri 
ciples with his educational practice without having his efforts in the schoo 
room appreciably improved. 

CHARLES ForDYc! 
Department of Educational Measurements and Research, 


University of Nebraska 


BURTON, WILLIAM H. Supervision and the improvement of teaching. New 
York: D. Appleton & Company, 1922. 510 pp. 
The introduet ry sentence of the Preface states that this book is 


bie 


ittempt to discuss concretely the problems and procedures of the elementary) 
pervisor.’’ In realizing this aim, the book mentions hundreds of tl 


problems that the supervisor will meet in his daily work. It, also, suggest 


effectual ways of handling some of the multitudinous, varied, vexing, a 

oft times baffling problems which every true supervisor has recognized. 
The author’s point of view is that of the scientist. In developing | 

subject he uses experimentally determined evidence, when it is availabl 


When such evidence is not available—and generally it is not—recourse is 
taken to expert opinion. The author well recognizes that many of his ge 
not final, but he advances them tentatively with the hop« 
that they will stimulate supervisors to study their problems in a thorougl 
scientific way. Excellently annotated bibliographies after each chapter 
are calculated to aid supervisors in further study of their problems. 

The book ‘‘ gets down to brass tacks.’’ It is concrete and practical. It 
first-hand acquaintance of the author with the supervisory situa 
tion and it is written so that it can be easily read and understood. It is a 
book that can be used—a book that admirably meets a professional need in a 


field that has all too long been uncultivated. 


g 
Since it is written primarily for those who have the duty of supervisins 

it will make its strongest appeal to superintendents, principals, and genera 
1 special supervisors—whether in training or actual service. But discussing 
as it does the principles of general method and giving, as it does, an insight 
rvision, it should make a strong appeal to the class 


nto the problems of sup 
room teacher as well as to the supervisor. Indeed, the book is one that car 
be read with pleasure and profit by all members of the profession from th« 
niversity president to the teacher in the elementary school. 


Warp G. REEDER 


Ohio State University 














REVIEWS AND ABSTRACTS 


NG, E. he JR. Brie f introductory psi chology for teachers. Baltimore, Md. : 
Warwick and York, 1922. 241 pp. 
growing audi- 


pertinent for 


Strong has to say is of importance to a 
that is psychologically acceptable is 
hers, has to select but little of 


Whatever Doctor 

Not eve rytl ing 
Any author of a psychology for teac 
selections here made are in sharp contrast to 


available material. The 


of Strong’s book overlaps the educational 


iling custom. The content 
chology textbooks bound to be written during the next decade under the 
is of the new dynamic psychology more than it does the texts of the past. 


s book sets for its task the building up of four main concepts in the 
g of actions, including thought, 


1) the understanding 


1 of the reader: I 
terms of Thorndike’s ‘‘situation-bond-response’’; (2) a concept of learn- 
y as adding bonds; }) individual differences; 4) elementary statistics 
ges, deviations, correlations for use in grading, classification, and 
ri al educational thinking. 
The book attempts with far more than indifferent success to approach 
leal teaching situation of ‘‘ pupil acti, teacher passive. The illus 
ns from the very start are striking, often dramatic, uniformly ‘‘pat.’’ 
diction is congenial, friendly, and the opposite of highbrow in the offensive 
With a few exceptions the reading difficulty of the content is not 
The book is divided into thirty lessons of reasonable length. In 
pil ’ subje t. the first lesson is often an < periment to be written up, 
ext scussion of principles involved in the preceding experiment 
Learning, th prece de resistance, is the meatiest part of the book. The 
’s treatment here is clearly superior. He might have stressed a little 
the importance of certain characteristics of successful practice or exer 
Nor is it ¢ r why, with his unusual knowledge of the differences be 
en success and failure in industry, he had so little to say about motivation, 
terest, and the effect of satisfaction and annoyance in learning. 
[he treatment of individual difference is clear, to the point, and connected 
real problems of the schools. The treatment of grading, although enough 
es are consumed, leaves the reader entirely uninformed upon many im 
tant aspects of grading—how to construct reliable and valid examinations 
instance. The whole topic of marking is unfortunately discussed with th 
versity problem as a background. The students of this work are pres 
more interested in elementary and high-school affairs. 
The treatment of statistics is not worthy of the author. His decision to 
luce the beginning student to the statistical approach to educational 
lems is, in the reviewer’s opinion, excellent but his handling of the 
t spoils it. No mention of ‘‘probable error’’ and no place for 
‘reliability’’ are found This is a mistake because thinking guarded by 
tions of reliability is of prime usefulness to the group for whom this book 
repared. The development of skill in computing correlation is tried for 
it never justified. The author wants the reader, very properly, to be able 
to understand the more frequent statistical terms in professional discussions 
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and at the same time teaches average deviation and neglects standard deviation 





entirely. This is a mistake, for his readers will hear of standard deviation far 
6= D® 


more often than of average deviation. He gives the formula, 1 — 


for the coefficient of correlation r. which it is not. 


f ; 
The treatment of educational and psychological tests are hardly mor 
than press notices The last 45 pages of the context are ** poor relations’’ 
to the rest of the book. The evidential material supplied from experimental 
rk could have been strengthened by referring to more recent reports 
teferences t lata published since the first edition of this book (1919) ar 
é sent. With the exception of these last 45 pages, however, t! 

prove a stimulating and satisfying treatise to the student of g 

era ~ and the lay reader as well as a valuable text for the teacl 


Mifflin Company, 1922. 154 pp. 
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‘ ‘ ‘ } Ir} q li . oO ita « | ie ’ ‘ et the ™ ft ont 
‘ Q that 3 if 3 , ntl +} rete ng f the tal ] ; 
f { { t that edueation on this continent was uF 1 fre 
tset Ss I il Tunctior i l at pubil ob] t I t it the | ibl 
t reatest possible safe rd for democra that « eation should 
loy lity as well as social adaptability nd that education must 
I t t wit! bilé na re if it stot ich men to Sp ik wit 
1 t s the Scribes and Pharisees These various topics al 
t four chapters whic constitute the volum«¢ nd which a 
} sent t titles, ‘‘The Na nal School,’’ ‘*] catl for Der 
| t It iduality,’’ 1 ‘*Ed n for Authority.’’ 
\ and for a type of ¢ eation t takes ace nt 
t ! er things of e, the | K ntains 1 to ymime 
! nes ea reciati with magr nt expression Pe 
e » 1 fault wit] » competent 1 whole-souled a 
Yet the 1 ler is | t with a general ir ression that the autl 
att | t 1} lage t al mastic ar traditional cor eption ¢ 
I s zeal for de ocrat he advocates ‘‘an undi led, gener 
rs I n, broad ler tic p. 55), without sufficient realiz: 
t I rT tne I t ti tL vor tional interests n be mad to s ve the ends « 
t ur f rac e fact that his conception of public educati 
takes little cognizance of individual differences is acknowledged, at least in 
ectly, but it is « med that ‘‘the school has a mass work to do, a natior 
to perfor to educate for democracy; the education for individ 
y must be given us everywhere, but not in any school’’ (p. 93). This work 
must be left primarily to the home. Most significant of all, pe rhaps, is the 
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’s failure to recognize the meaning of science in education and for 
racy. He seems wholly oblivious to the fact upon which Robinson’s 

‘Mind in the Making’’ places so much emphasis, viz., that science is a con 
is example of the process by which intelligence must be liberated from 
and tradition and pressed into service for the betterment of human life. 

In a word, Mr. Sharp’s doctrine of education is warmly and generously 
ved, but it is cast too much in the mould of a literary tradition. It 
s too lightly over the educational experiences that have accumulated 
the days of Rousseau. The significance of these experiences is that we 
st take a more painstaking account of individual differences and of the 
g of science, in order to convert our aspirations for democracy into 
evement. 
B. H. Bop 
State Unwersity 
KIMBALL, Mental differences in certain immigrant groups. (University 
f Oregon Publication, Vol. I, No. 11, July, 1922.) Eugene, Oregon: The 
University Press, 1922 103 pp. 
This study was carried on under the direction of Professors Cubberley 
Terman at Stanford University. More than 500 children in San Jose, 
yrnia, with additional children from smaller neighboring towns, making 
tal of approximately 800 cases, were studied. The racial groups investi 
1 were those of (1) North European ancestry (called Americans 
2) Italian ancestry, (3) Portuguese ancestry, and (4) Spanish-Mexican 
estry. Only children above 12 and under 13 years of age were included. 
The data obtained consisted of the results of (1) Army Alpha test; (2) 
Army Beta test; (3) teachers’ estimates of intelligence (two s¢ parate judg 
' nts); t) teachers’ estimates of school work (two separate judgments) ; 
chool classification; and (6) occupations of parents. The data were 
obtained and handled by the author or trained assistants under his direction. 
The Italians, Portuguese, and Spanish-Mexican groups were found much 
in essential respects, and were classed together as Latins to be com 
i with the North European descendants classed as Americans. When 
is classed, Mr. Young found that (1) in Army Alpha, only 7 percent of 

Latins exceed the median of the Americans; (2) in the Army Beta, only 

6 pereent of th Latins exceed the median of the Americans; ; in 
achers’ estimates of general intelligence, the Americans exceed the Latins 
one-seventh of the range of the rating scale from ‘‘very inferior’’ to 
very superior’’; t) in teachers’ estimates of school work, the Americans 
the Latins by one-seventh of the range of the rating scale; 5) in 

le location, the Americans excel the Latins by nearly two half-year grades; 

1 in occupational seale, there is a rough relation between economic class 

i the mean intelligence of the children. These are striking differences. Mr. 


ng’s very careful handling of his data, his scholarly attitude throughout, 


id his references to other supporting studies carry confidence in the validity 


conclusions. 
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The study sheds a bright light on the question of the part played by 
language difficulty in the differences among racial groups, repeatedly found in 
the intelligence scores. By correlations between the several sorts of data, Mr 
Young shows very conclusively that the language factor is by no means so 
great as is commonly believed, and that the differences in scores is much more 
largely one of native intelligence. This constitutes a genuine contribution 

Two adverse criticisms may be made. The measures of central tendency 
should be found with the distribution tables, pages 12 to 15. In many of the 
tables, measures of variability should also be given. It requires the distribu 
tion table with its measures of central tendency and variability all together 
to tell the reader what he wants to know. 

The above criticism is minor. The following is more important. 

In the judgment of the reviewer, chapters IV and v, have no place in 
such a publication. They treat supposedly of the applications of the data 
to certain problems of school organization and method, and of certain theo 
retical implications concerning culture progress. In fact, these two chapters 
form the vehicle for the author’s statement of his own philosophy of educa- 
tion, and his beliefs regarding eugenics and related fields, with but slight 
relation to the findings of his study. The reviewer happens to be in agree 
ment with the author on the most essential tenets held, but reading the splen 

1 study reported in chapters 1, 1, and mt played little part in bringing 

ut that agreement. Chapters Iv and v should have wide reading—far 
wider than will be accorded them when printed following the technical treat 
ment of data in the study. 

As a matter of sound practice in publication, studies such as Mr. Young’s 
should not be mixed with theoretical discussions. 


F. J. KELLY 


University of Kansas 














pi News Items and Communications 


; This department will contain news items regarding research 
Hon workers and their activities. It will also serve as a clearing house 
ncy for more formal communications on similar topics, preferably of not 
the more than five hundred words. These communications will be printed 
over the signatures of the authors. Address all correspondence con- 
cerning this department to Doctor E. J. Ashbaugh, Ohio State Uni- 
versity, Columbus, Ohio. 




















lata At the San Jose State Teachers College the Annual Conference on Edu- 
1e0 tional Research and Guidance will be held on April 20th and 2l1st, 1923 
ters tor Buckingham of Ohio State University will be the principal speaker 
ICA i outside of the state. 

rht 

reg It is reported that the collection of money among the pupils of the New 
eT ; City schools exceeds a million dollars a year. An effort is being made 
ing gulate this matter. 





at The Méras-Roth-Wood French Seale comes in the form of a 14-page 
t ntaining general tests in comprehension and vocabulary followed 
rs crammar tests for each of the following grades: VIII-A, VIII-B, IX-A, and 


Tests in cultural information and pronunciation are also included. 

es of this test may be obtained from Doctor Ben Wood, Hamilton Hall, 
ia University. 

The Detroit Freehand Lettering Secale, Experimental Edition, includes 

ll booklet containing specimens of lettering ranging in quality from 

to 39; a pamphlet containing directions for giving, scoring, and tabulating ; 

ons to students and blanks for the lettering Test A, Forms I and II 


se may be obtained from the Board of Edueation, Detroit. 


Miss Etta A. Dunn, head teacher of the Andrews School, Pittsbur 


yivania, writes that the upper classes of that school are being tested 


find out definitely whether the project method functions more completel) 
the traditional method of teaching.’’ This is an interesting instances 
experimental attack on a problem about which much unsupported 
is being expressed. 
Ty 


in response to a fre uently repeated request for lists of books suitable 
1 : I 


the library of the small high school, the Department of Public Instruction 
Michigan, together with the Library Extension Service of the University 


Michigan and the Librarian of the Michigan State Normal College have 


Or 
avi 
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oncludes that ‘‘on the whole attendance appears to be a 
achievement but not so weighty a factor as n any woul 


mming up the evidence from a large number of cases it 


the percent of time which a pupil attends school has 


upon his achievement age at the end of the period unde 
that it has practically no effect upon his actual increase 


unless his attendance record is very poor in which case 
} 
I 


same semester and increases it for t 


1e following one, al 


closely related to his average school mark for the san 


f Edueation n ¢ <tende 1 discussion was held on the ~ 
echo rrading The sel | pe ple of New York C 
x<tensive use « hese tests lately Some of them ha 
ne time others did not fall to line unti t beear 
nistration, including the Board of Examiners, was sy1 
f these instruments At the meeting to which we a 


provided they are supplemented by additional informa 
wit thie co ius s to hn ot r &s ] people } 
‘ | ) nt 


D of the findings of the Committee « grading at 
ite Superintendent Shimer, chairman have recent! 
\ York Evening Matl. The following important facts 
ut oT {80 schools reporting, 179 promoted pupils 
5 pereent ol the | ipils S0 promoted sustained then 
l g les Reg ing « classes was practiced in 222 
f usses were organized in 152, opportunity classes 
neement groups within classes in 177. Intelligen 
Re Is las ear to select bright pupils; and sta 
‘ or ‘ bv 52 others In 218 sx ols teacher 
s 1 basis I | moting bright pupils The « 
tes Ss esse il | rt f teacl ny 
the 1010 ¢ eT ude } O30 « ld rey wm the Thorndi 


sin State Department of Public Instruction finds that 
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be a mbination of unrelated elements. 5) Six percent were due to mis 


youl eOl 


is errors. 


es it Following this summary of the errors Mr. Osburn gives in his circulat 
as led and Diagnostic Paragraphs for Use in Silent Reading,’’ a series « 
inde graphs to be used in remedial treatment. At the end of each section | 
se scusses the diagnostic value to be gained from a study of the types of 
se which occur in children’s answers. 
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University of Michigan, reports the results of t Henmon | 
us 
ry and Sentence Translation Test Test II, giver n May, 1922, t 
Is I Lat nm mm t} } rn scl} ls ot ter ties f the state c's 
en 
. t findings are summarize s follows 
ae Comparison of the median scores attained in the different cities in bo 
= nd senten translation tests ndicates that thos ( es that 1 
; scores n the vocabulary test Iso 1 high scores on the tra ! 
I The Bure 1 has not had time to figure the corre tion betwe thes 
s of seores, but it is reasonable to sug st that the abilit to t ns 
uries with it the recognition of word meanings. There is some eviden 
the opposite of this statement, that being g 1 i eabulary 1 i 
good in translation, is not so universally true. Most of the Michigan 
“ ( ip to standard in vocabula E but not s mal f the were ' 
ndard in the translation test. If the two sets the Henmon standar 
l relial then it ust be col cle l t it mere I pre I 
' suff ent to use tl Michigan cities to attain tl x pect st irds 
; 5 
t ' siation Exact translation demands know! ge « eral ir sv { 
S18 n number, tense, cas mode, sentence structur ete., and als the 
T ‘ ess thie meaning i! ele ur 4 eet ky lial ; 


fe Intelligence Tests At the request of the Fife (County Educat 


of \uthority, Doctor Rusk, acting as Honorary Consulting Psychologist, | 
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pared a set of group tests which were given to the pupils who came up fi 


e secondary-school entrance examinations last year. The tests which appe:z 





in the Fife Intelligence Tests were chosen after considerable prelimina: 


testing and the order was determined by their correlation with the Stanfor 


Revision of the Binet scale. At the time of the examination, these pupil 
+} 


were given the usual entrance examinations and the Fife Intelligence Tests 


In the opinion of those in authority, ‘‘the introduction of intelligence test 


into the Fife County examinations has led to an increase in the number < 


gifted children admitted to the higher grade and secondary schools of th 
county It is thought that the former examination emphasized too strong] 
the results of memorizing to the disadvantage of reasoning force and judg 
ment The inclusion of intelligence tests, on the other hand, has drawn int 
I ler relief the natural intelligence of the child, and a result of this « 
hardly be espised in tl process of selecting y g people for more : 
‘ need at a 


Miss Theresa E. Baller, chairman of the English Department, McKin] 


Junior High Sel l, Los Angeles, California, reports tl results of tl 
hort ke-Met Re I pcalk distribute accord ng to } telligence q! 
tients rhe latter tained by the use of the Terman Group Test ] 
sual six classi tions according to intelligence quotients are set up and 
each of these classifications the number and percent of pupils receiving ind 
cated rea yr quot ts e er ed Pupils having intelligence quotients 
above 140 have res ng quotient n no ease less than 105: those whose intel 
juotients are between 120 and 140 do not do as well although they over 
ip extensively both beyond those in the next higher and those in the next 
er inte pen fy Similar statements 1 be made with reference t 
pupils ! tl lligence classificat s In eneral reading abilit 
es t t ore here is, howeve such a marked degree of ove 
lay ¢ that t o1 two intelligence groups which are absolutely distin 
F each other o7 e basis of reading quotients are those which have I.Q 
e 140 and those which have I.Q.’s between 70 and 80 
Miss Baller na ites that she is retesting all pup ls whose ré iding al 
nts gence a ‘tients show ma ed dis repancies and that she expects ti 
make a special stud f the eases which continue to show sucl iscrepar 
fter the retesting 
Last s gf teresting contest took place in Cloud County, Kans 
Alt igh this WAS neariyv a ve r grt the features of this contest have prese 
nterest Director Dean A. Worcester, of the Bureau of Educational Measur 
ments and Standards at Emporia, had charge of the project. It seems that 
( i County, as in so many other counties, contests of athletic, musical, ar 
terary abilit had ‘ held annually Last spring the competition was 
extended to ineluds academic subjects The plan was to test the childre 
in the morning and to have the papers graded so that awards might be made 


on the evening of the same day. Students entered the contest as they wou 
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an athletic contest. Medals and cups were given for first, second, and 
places. 
The subjects in which testing was carried out were English composition, 
i States history, civics, first- and second-year Latin, algebra, geometry, 
al training, home economies, and physics. Standardized tests were not 
ecause many of the children were already familiar with some of them. 
bureau of which Mr. Worcester is director undertook to provide the 
nination questions. Some of them were of the true-false type, others of 
iltiple-choice type, and still other of the completion type. From the 
re of the case the examinations had to be easily, rapidly, and objectively 
[he project was very successful indeed and attracted a good deal of 
est throughout the section of the country in the vicinity of Cloud County 
Worcester writes that he considers it ‘‘one of the most valuable pieces of 


, 


that we have attempted this year.’ 


e experiment which is being carried on at Los Angeles, California, and 


} 
xh which children who are behind in their work are brought up to grade 
so-called ‘‘adjustment room’’ is attracting attention rather widely. The 
AL has already published a brief outline on the subject, but a much 


treatment of it appears in the form of a handbook published by the 


rtment of Psychology and Educational Research (Doctor A. H. Suther 


Director). This handbook is ds signed for the use of teachers of adjust 
ms. A reading of it and an examination of the adjustment progress 
impresses one exceedingly favorably. In some of its aspects we ar 


ed of the individualized instruction which Superintendent Washburn« 
Vinnetka, [llinois, has been carrying forward. There is, however, a great 
that is original in the plan as it is being worked out at Los Angeles 
brief article by Doctor Sutherland in the September 1920 issue of thé 

tary School Journal relates particularly to the reading work in the 
stment rooms. Doctor Sutherland also indicates in this article that a 
iment is under way in the application of the special materials in r 
~ Half the children in grades m to v of a certain school are u 
aterials: while the other half follows the old plan. We shall be glad 
ad Doctor Sutherland’s report of the experiment when his data justify 


in publishing it. 


> 


During the Christmas vacation Dr. B. T. Baldwin, director of the Iowa 


Welfare Research Station, organized a comprehensive investigation for 
public school system of Cleveland, Ohio. The progress of children is t 
sed on their physiological, mental, pedagogical, and social ages. 
Typical schools in each of the five city school districts have been selected 
the work will be carried out by the superintendents, the five supervisors, 
the principals of the schools with the direct cooperation of the depart 
} 


ts of instruction, educational research, psychological clinic, health, physi 


aining, and nutrition. The program will include two semesters’ work of 
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classes from kindergarten through the junior high school. No effort will | : 
spared by the school authorities to make the experiment thorough and practic: 

Mr. W. A. Justice, director of research at Virginia, Minnesota, has lat 
ssued a report of the work done in his department last year together wit 
an announcement of his plans for the current year. As to the work dor 
last year, forty-five items are briefly described. These include not only testing 

tivities but such other matters as pupil distribution, school census, pract 
materials, teaching load in the high school, salaries and cost of living, nor 
promotion and retardation, enrollment cards, under-weight pupils, and oth 

erally too erous to mention.’’ One is impressed by the unusual rar 

f the activities of the Research Department at Virginia. 

Mr. Just writes that the introduction of a filing device involving t 
ise of individual folders for pupils is probably the biggest thing his depart 
ment has done With particular reference to this filir rg syste m he says 5° A 
re ds of achievement and intelligence tests—group or individual—are pla 
in the respective folders. In a year or two we shi have gathered in tl 
file f bocy of information concerning each child, to be used for industr . 

eational guidance. Those who are interested in a record blank on wh 
to earry the results of testing will wish to see the form used by Mr. Justi: 
The endance and scholarship record of a pupil for a year is exhibited « | 
one le of a 8%, x11 sheet for loose-leaf binding. On the other side is tl 
pupil’s reeord eording to standardized tests and scales Sinee the re« 
3 te l to ¢ é but one year it is easy to provide fi every entry like 
t ed Presumably at the end of the year the form is filed in t 
“ le Thus over a period of time the data on standardized tests f 
l mpletely show1 The plan, however, fails to provide, 
« . t 1 ¢ ’ , for a continuous test record which shall cover t 
f the « and wh shall be exhibited on a single form. 

I t f training institutions has been espe lly observal 
! ! s. This growth is the resultant not only of the large increas 
the 1 | high-s l craduates—i in the number of students prepar 
to ¢ r the t her-training institutions—but also of the very great number ¢ 
tea s a¢ ‘e wl ire availing themselves of the additional training wl 
t se t itions ff Ll. 

N at oy ¢ nee f ti latter source »f gy owth has come to 0 
ttention than that which is reported in The ine Buffal 
for December, 1922. Ace« g to an editorial is stated tl 
the educational department neithe ges nor on the p: 
of teachers in service of the opportunities for additional training. It is f 
ther stated that increments of salary have not been conditioned upon t 
taking of extension courses. Under these circumstances the record of exter 
sion work done by the Buffalo teachers is indeed remarkable During tl 
past four years the have earned credit for 16,815 semester hours This does 
not include the work done by 130 teachers who during this time secur 
degrees, nor does it include attendance upon courses for which college cred 
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ll } ; received. When these two types of work are included, 
t semester hours is reached. This is the equivalent of mors 
rs of college work. It amounts to 10 semester hours f 
ati Buffalo system, or a little more than an hour per week 
wit ghout the entire four years. 
. f this amount of work had been accompanied by the us 
st ’ t would have represented an expenditure of more thi: 
cl s As a matter of fact, it cost the teachers almost nothing 
I time the editorial to which we are referring was written, 
th teachers in the Buffalo system were reported as havir 
a work for professional improvement during the fou 
| S tendent C. C. Underwood of Painesville, Ohio, | 
sid s secured from the Illinois Examination with the sue 
ol work to form ability groups. So far as this ] 
£ les below and above the seventh and eighth, i cs 
tr . rintendent Underwood’s arrangements materially ffer f 
vl een reported by other people. 
sti the seventh and eighth grades, how he is using 
d ch section—1i.e., in VII-B, VII-A, VIII-B, and ViItIl-A—pupils hi 
3 1 rding to the amount of work they are capable of doing 
telligenee scores. Those who are doing exceptionally gi: 
ke é ting signments, their classes are large, and tl 
t instruction is relatively small. Those who : doit 
s 1 easier assignments although, in general, they cover t 
é sections are smaller, and more individual help from 
most distinctive feature of Superintendent Underw 


y which he handles the remainder of the pupils in 


a grades from vVII-B to VIII-A, inclusiv All of thes 


S t to grade are put in one group ealled Class A-] Me 
yal er age and mentally below normal. Their school work 
er ive an entirely different course of study from that of 
It is taught, in the main, by the project method 
f individual assistance is given | he teacher Che 
ind all periods are really supervised study per . 

fal ted without regard to the kind of work the , pi 

t that they have done their best In other we a \ 


f me is true of pupils in VII-A, VIII-B, and VIII-A Pupils 
. 4 however, go to the ninth grade as Spt | pupils and ar 
xt ed for the regular high-school work heir curricul 
= ’ l arts ind allic l ubjects 

dor rhe distinctive feature of this grouping is the organizat 
ure the subnormal pupils of the four half-yearly grades ar 


re the basis of effort. 








1 grand total of 
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At Seattle, Washington, there has been a movement directed toward the 
establishment of an educational survey. This year the Board of Directors 
established a Department of Research for the public schools, and Professor 
Fred C. Ayer of the University of Washington was appointed director. T! 
Board in conference with the Superintendent laid down a program of topics 
for special study. One of these had to do with the organization of the scho 
system. 

Accordingly, Professor Ayer sent a circular letter to certain educational 
people asking them to judge each of four types of organization by using ter 
criteria. The four types of organization were named and defined as follows 

the first three already exist in Seattle and the fourth is being considered) : 


I. Academic.—The conventional organization in which approximately 
forty pupils are taught by one teacher in one room throughout the school 
day. The pupils are divided into two divisions which usually alternate in reci 
tation and study or special occupation. The teacher is assisted by an occa 
sional visit from special supervisors. 

II. Industrial_—Essentially the same as the Academic in the first six 
grades. In the seventh and eighth grades from sixty to seventy-five minutes 
daily are given to girls’ home economics and boys’ shop work taught by spe 
cial teachers in a special room. Time for this industrial work is taken from 
the academic subjects. 

III. Duplicate—The school work of each classroom group of childrer 
from grades Iv to vill is organized into two equal parts, (a) academic and 
(b) special. The academic work (reading, arithmetic, ete.) is taught by or 

teacher in the home room while the special work (music, manual training, 
penmanship, ete.) is taught by special teachers in especially equipped rooms 
Two groups of children shift between the home rooms and the special rooms 
each quarter of the day. The school day is lengthened and more time and 
emphasis are given to special subjects and activities than in the academi 
schools. Teachers ordinarily have but a single division of pupils at a tim 
The division, however, is usually larger than the recitation division of th: 
Academic grouping and may be several times larger with certain of th 
special subjects. 

IV. Junior High School.—A plan of reorganization which groups grades 
VII, vil, and 1x (high school) in one building. The work is semi-depart 
mentalized upon the duplicate plan, promotion is by subject, the curriculur 

is broadened, courses are differentiated more widely and more attention is 
given individual variations, guidance, and social organization. 


The recipients of Professor Ayer’s letter were asked to judge these fo 
types of work with reference to the ten following points: attendance, progress 
achievement, curriculum, instruction, supervision, administration, guidanc 
socialization, and low cost. These ten items were carefully defined in tl 
questionnaire. 

Professor Ayer says that the general topic of organization is particular! 
pressing at Seattle owing to the impending building program. We hope that 
he will make his findings generally accessible not only because of the wid 


interest in them but also because building programs are contemplated in man; 


other cities. On the basis of his returns, Professor Ayer indicates his inte: 
tion of making a quantitative study of the ten factors (attendance, progress, 
etc.) as they may be found in the three types of organization now in operati: 

at Seattle. 
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We feel that this study is important and we hope that in due time a 
rt of it will be made available. 


There is a great deal of present interest in the building principal. One 
which this interest is taking is that of inquiry into what he or she is 


We wonder what our readers will think of the following *" report of 


ies for one day by a grade principal.’’ 


About 8:20. Arrived at the building. Marked a set of papers handed 
Monday evening. Received money from children for tickets and costumes. 
ked this on list. Sold a book. Sold some paints. Made change for both 
lren. Talked with Miss J. about L. J. who is not doing good work this 
ster. Helped Mrs. B., a substitute teacher, plan work for the day. 
ked up in our Classification List the set of lantern slides needed for ‘a 
m soon. Made out the list of supplies I wished the janitor to get from 
office. Heard a complaint from E. H. about R. B. hurting her with a 
ball. Investigated—heard both sides. Returned papers I marked and 
i with pupils about them. Talked with Mrs. B. and Miss J. about three 
n who were absent. Signed several bank cards and took them to the 


9:30-10:00. Gave music lesson to Room 11 and Room 12 combined. 
ted some Christmas music we had used, marked it, and filed it away 
d out some books I had used for reference on Indian costumes, and 
rned to teachers. Returned some reference books to three rooms. 
ged some textbooks in office preparatory to counting for book report. 
10:30-10:45. Watched boys go to the basement and out for recess. Boys 
rted something wrong with merry-go-round; had janitor fix it. Looked 


nd for and asked two teachers about an old Aldine Chart that Miss J. 
] 


3K for. Reported to Miss J. Made out an alphabetical list of names in 


11 to be used in making index for permanent record. Mr. H., manual 
ning teacher, called about some plans for next week’s work. Conferred 
Miss B., and reported to Mr. H. Went to three rooms and consulted 
h teachers about the spelling of some pupils’ names over which there was 


lisagreement in the lists sent in for permanent record index. Consulted 

Miss G. about some new material for our ‘‘ play store.’’ Looked through 

books to find a certain story about Booker T. Washington. A patron 
he school had asked me to find this story for her to use in a club meeting 
ined M. R.’s arithmetic paper and recorded her grade. I do this every 
because her mother was not satisfied with her marks last month. Made 
uutline for reading lesson and gave to Miss J. for her to put on-board. 
i through records of a teacher who is absent to find data for a card to 
for a boy who is leaving town. (Report card for some reason had not 
illed out.) 

12 noon. Went home. Met Mrs. H. and talked with her about D.’s work 
school. 

12:45. Returned to building. Arranged lists of names sent in by teachers 
index. Talked with Mrs. J. (a substitute) about some pupils who are 
doing good work, and also about an absentee. Heard a complaint from 
girls who were hit by snowballs. Investigated and reported to boy’s 
cher. Examined a little girl in Room 1 who looked ill and had fever. Sent 
r home. Visited Rooms 1, 2, 3, and 4 to find a little girl whose mittens 
1 been taken. Found the child who did it and sent her for them. Looked 

igh Miss M.’s desk to find her bank cards and helped Mrs. B. (a substitute 

» cards for the day. 
1:40-2:10. Gave a fifth-grade reading lesson in basement. Had an inter 
with Mr. B. about some bills he wanted given to Miss C. 
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2:15. Returned to office and found Miss A. from Y. W. C. A. who came 
to talk with me about Girls’ Reserve for next semester. Visited Rooms 7, 8. 
9, 10, and 11, to find how many girls are twelve years old or more. Sent a boy 
to office with report. F 

2:30-2:45. Watched boys from six upper rooms go to and return fro 
basement. Took a little girl’s temperature, talked with her, and put her to 
bed on the couch in the office when I found her mother was not at hom« 
Talked with a boy who is doing poor work in school. Wrote his mother a 
letter explaining what I think is the cause and asking parents’ cooperation. 
Mother is deaf so I can’t talk to her over the phone.) Signed some bank 
cards and took them to rooms. Went to Rooms 9, 10, and 11 to announce a 
meeting of Girls’ Reserve after school. 

30. Counted bank money—#$26.03. Signed more bank cards and fixed 
ip my record. Took money to Janitor to conceal some place in building as 
[ didn’t get it counted in time to send to bank before three. Talked wit! 
the girls who stayed to attend meeting of Girls’ Reserve. These were pros 
pective members and all had questions to ask. Mrs. W. came to conduct th 
meeting. Talked with her about plans for next semester. Made plans with 
Mrs. B. about her sewing lesson for tomorrow. 

1:25. Left the building. 

t:30-5:50. Attended Teachers’ Club at A school to hear lecture on 
Passion Play 

During th 
remember when nor what the calls were. 


day I answered the phone a great many times but can’t 


Arithmetic Skills of Prospective Teachers 
nic scholarship of teachers in training has often been the sul 
Teachers in colleges of education and normal 


‘t of animated discussion. 
i nt to say that their students know little of history, geography, 
and arithmetic, and that their skills in reading, spelling, English composition, 
and arithmetic are far below desirable levels. 

On February 9, 1923, the writer gave the Courtis arithmetic test 
Series B, to 104 freshman women,—students in his course, ‘‘ Teaching Arit! 
metic in the First Six Grades.’’ Their median rate scores were: addition, 

y 


13.2; multiplication, 11.4; division, 10.8. The eightl 


10.3; subtraction, ‘ + 
12; subtraction, 13; 


rade rate standards, set by Courtis, are: addition, 


multiplication, 11; division, 11. It will be seen that the median scores o1 
these students are practically coincident with the eighth-grade standards 


except in addition. In this operation they rank as sixth graders. 
The median accuracy scores, expressed in percents, were: addition, 65 
subtraction, 83; multiplication, 72; division, 85. The eighth-grade stand 
ards,-as reported by Courtis from testing done in 1916, are: addition, 76; 
subtraction, 87; multiplication, 81; division, 91. It is evident that these 104 


college students are less accurate than eighth-grade pupils in each operation 
In fact the accuracy medians are practically identical with those attained by 


j 


i 


fourth-grade pupils in addition, fifth-grade pupils in subtraction, and sixtl 


rade pupils in division, while in multiplication the median is just midway) 


between the figures reported for pupils of the fourth and fifth grades. 
The writer has frequently asked school men what they thought should b 
the minimum degree of skill required of prospective teachers in the fou 


fundamental operations with integers. No one has been found but would 











1 e eighth-grade median performance or better in each operator 
» that we apply this standard to our 104 freshmen. 
Of the 104. the addition rate standard is attained by 28 
' Of the 28. the addition accuracy standard is attained | 9, 
‘ 
“i Of the 9. the subtraction rate standard is attained by 8. 
ra Of the &, the subtraction accuracy standard 1s ittained by 
Or Of the 3, the multiplication rat standard is attained by 
ADK Of the 3, the multiplication accuracy standard is attained i 
‘ 
This o1 eaches the division standards in b rate and accurat 
mt on of the eighth-gra le median standards d I ‘ » « 
} ecrults 
( We n tell the story in another way. The sta ird t t 
t °8 in addition, 54 in subtraction, 57 in 1 iltiplication, and 48 in d 
ut und i for accura was met by 27 in addition 8S in subtrac 
tiplicatio and 34 in division. The number of students atta ng 
‘ ! accuracy sta iiaards was 9 in addition, 22 1 ibtract 
ation, and 25 in division. 
D R. L. Mo 
é ty 
On Doctor Bagley’s Rejoinder 
\\ one hesitates to intervene in the gladiatorial contest « Kas 
! er the 1.Q and its significance, or to do anythu that cht | 
I leet | display that it has occasioned, the following « I 
Bagley’s rejoinder in your December issue may not come mis 
» to clarify the issues. 
st oct Bagley sumes that 1 lers will infer that because all 
it! e of utilizing writing once it was invented, therefor were ( 
nting it, that the ability to apply a discove is equivalent t 
{ to make the discover, TI users of motor cars and of 
1 presumptuous This instar of writi is il trative | 
ri 3 pr pl Ever in demo tie ( munities the 
s not originat policies ; he merely accepts or rejects the 
the poliey which he has » part in originating e bette 


resent 
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succeeding generation and that this has throughout the ages remained ¢ 
stant. But the Terman I.Q. is an I.Q. of individuals, not an I1.Q. of 


- + 
0.« 
+ 
¢ 
oO! $ 


the 














collective common man. What the mental tester affirms is that the L.Q. of a 
ndividual is innate. He does not seek to explain its origin or to fix respons 
ility for its possession. He would not be surprised to find that even wh 

both parents have an I.Q. of 100, the L.Q.’s of their children were distribut 


s: 80, 90, 100, 110, 120. All he would say is that the child with tl 


80 1.Q. would not go as far as the child with the 120 I1.Q. The mental teste: 


leaves the explanation of the differences in the I.Q.’s to speculative philosoph 
e Doctor Bagley. Doctor Bagley assumes that the horizontal growth 


il might compensate for the vertical reach 


the 120 1.Q. individual; but the assumption that the horizontal reach mi 


ry} rnaike will explain to Doetor Bagley. The relative ‘*low visibility’ 


fference between the common man and the genius which Doct 





Bagle: irds as a ‘‘ecrucial instance,’’ may be due to the fact that tl 
edueation provided for the genius has not been adapted to him but rather t 
the common mat In eases like J. 8. Mill, where the education was special 
evised f his higher eapacity, the difference was more clearly manifes 
[he mental tester has not investigated whether the general average of I.Q.’ 
t ) generation remains constant, and he is consequently 1 
to make dogmatic statements about it. Any view of this questi 
attributed to him by Doctor Bagley is unjustified. 
The correlation between the army tests and educational facilities cit 
vy Doctor Bagley I lue to the ict that as a country gets the gover: 
if esires, SO &a ite may get hich it has t 
t , é 1 bene I is subject 
the « ( e! f tl commor! i ores throu 
t is that moerne s not an existing entity, but constituted out of ind 
s with different capacities, and he seems to forget that, as T. H. Gre 
id, ‘* There enn be nothing in a nation however exalted its mission, 
f ly organized, which is not in the persons compos 
t societ The spiritual progress of mankind is an unmeaning 
less it ins a progress of pe rsonal character and to pe rsonal chat 


[It is simply unintelligible unless understood to be in the directior 


perfect forms of personal life.’” 


Ropert R. Rusk 
{ / I ersit - St 1) d ews, Scotland 


Educational Research in Music 
Edueational research in music is a pioneer field. For example, the Hill 


scale for measuring ability in sight-singing contains the only star 


educational tests in the field of vocal music. There are indications, 


I 


he next few years many valuable educational research 


Prolegomena to Ethics, §§ 184, 185. 


y with the vertical reach is more likely to be valid, as P: 


il 
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isic will be produced. At present there are only a few workers in the 


he only tests now available are the following: 


Music Intelligence Test by Glenn Gildersleeve of Washington Junior 
School, Rochester, New York. The work was done at Columbia 

versity. 

Beach Standardized Musie Tests by Frank A. Beach of the Kansas State 
al School, Emporia, Kansas. 

Detroit Practice Tests devised under the direction of 8S. A. Courtis and 
s H. Chilvers, supervisor of music. 

Standardization Tests by Charles A. Fullerton of Iowa State Teachers 

ve, Cedar Falls, Iowa. 

Mood Musie by W. V. Bingham, director of the Department of Applied 
logy, Carnegie Institute of Technolog 

Measures of Musical Talent by C. E. Seashore of Iowa State University. 

Baldwin’s Public School Musie Test by Ralph L. Baldwin, 81 Tremont 
Hartford, Connecticut. 

Scale for Measuring Ability in Sight-Singing by E. K. Hillbrand, head 
Department of Education, Dakota Wesleyan University, Mitchell, 

Dakota. Work was done at Northwestern University, University of 

, and Columbia University. 


For the benefit of these who are interested in the field of educational 


music the writer offers the following suggestions for future re 
‘he problems mentioned here have come to the attention of the writer 
y x vears of work in this field. 
PROBLEMS FOR FUTURE RESEARCH 
Construction and standardization of a silent-reading test in vocal music 
attempts in this field are the silent-reading selections in the 
sleeve test, the few selections in the Beach test and the few selections i 
Detroit Practice Tests. This could be a group test. An oral reading test 
f necessity be individual. 
B. 4 truction and standardi I i separate te é ls, i 
( of their difficulty for pupil. The degree lifficulty of 
I rh be ¢ ermined | tl ~ ol ie v ( Ss sig! Ss cr y 
( Ss ( yT I 1 test I lvir y rl thmi¢ | itterns ( ay 
s of difficulty. This suggestion was urged especially by Miss Curry 
mbia. This would be a test for rhythm instead of intervals. 
i Construction of a test with interlaced selections, one select involvi 


als and the other involving rhythmic patterns. This type of test could 


sed for diagnostic purposes. 

5. Construction of a test with selections mit I le interlaced y 
ions in major mode. Some light might be thrown on the problem « 

her pupils sing selections written in minor keys as easily as those written 
or kevs 

6. Construction of a test where the single varying factor is the key 


ch the selection is written. Can the average child sing easier in one key 


another? 
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if a test with selections using words, interlaced with sele« 


ch the syllables are used. What is the importance of the verbal 


struction of a sight-singing test using the intervals which occur 


s. These might be compiled by obtaining from 100 fourtl 


‘ 


h-grade teachers, and 100 sixth-grade teachers a list of 
ch their pupils ean read at sight at the end of the school yea! 
uugh investigation of eye-voice span in vocal music. 

a thorough investigation of the number of eye-fixations, their 
heir length of pause for the different types of music. There ar 


marked differences between the reading of a simple one voi 


E. K. HILLBRAND 





Silent Reading in High School 

ree investigations are now in progress under the direction of the New 
wiety for the Experimental Study of Education. One of these is the 
int silent reading conducted by Section 25, Secondary English. The 
is taking two directions. The first is to discover what relation sub 
wee a pupil’s ability to read and his attainments in various field 
ro endeavor To determine his ability to get the thought from th 
gy thi forms of the Thorndike-MecCall Reading Seale have beer 
His intelligence has been measured by two forms of the Termar 

les M Ability or by a combination of the result on a Termar 
est ith his standing in the Otis Group Intelligence Scale. His 
ent three fields for two years—(1 English, civies, and history, 
é l foreign languages—is transcribed to cards from 

| cords, Most of this material for some two hundred and nity 
has | n gathered. The next step will be to work out th 
se 1 direction in which the inquiry is moving is to compar 
oF a set of classes taught during some fifteen weeks with emphas 
the exact thought from the page with another set taught without 
emphasis on thought. There will be an intelligence rating for each 
both sets of classes It is impossible, however, in the New York City 
ls to arrange these classes so that the teachers conducting th 
nt s have two classes of equal or equivalent ability. Much less 
he ossible to pair pupils in the parallel classes. In one of th 
EF 7 of the Thorndike MeCall Rea ling Seale was made the basis 
nging the pupils according to ability. Two other forms were mad 
the pupils’ reading ability. In other schools, three forms of 

‘ used to measure the pupils’ ability, without any effort to re 

f ipils. In all schools, two additional forms of the scale were given 
1 of the term to provide the final measure of reading ability. The 
s that the parallel classes of the ten teachers involved will furnish 
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tatistical basis for determining the effectiveness of teaching with emphasis 
the thought. The correlations with the intelligence rating of the pupils 

indicate whether the difference in teaching produced the difference in 
result. The investigations of Dr. Arthur I. Gates indicate, however, that 
rhorndike-MeCall Reading Seale measures chiefly depth of comprehension 
1 that its seores parallel pretty closely the intelligence scores. The chances 
securing very significant results with this part of the experiment are not 
bright as with the first part. 

These investigations have been started and will be carried through by 
ns of a subvention provided by the Commonwealth Fund. The expenses 
the materials and the clerical assistance, therefore, are to be met through 
renerosity of the Fund. A good many teachers, in several schools, have 
ributed their time and effort. The patience and zeal of these teachers 
have been engaged in the experiment is a proof of their professional 

English teachers in New York struggle under a heavier burden than in 
cities, so that any contribution they make toward educational research 
lves a genuine sacrifice on their part. 
DuDLEY H. MILES 
man of the English Department, 
Evander Childs High School, New York City 
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REPORT OF THE ANNUAL MEETING, CLEVELAND, 1923 


rhe annual meeting of the Association was highly successful. At the 


rst open meeting there was an attendance of 800 and great interest was 


wn in the papers which composed this program. The detailed program 
is printed in last month’s issue, so it will not be repeated here. 


rhe closed meeting was held Thursday forenoon. There was a small 


indicated by the size of the audience. Since the program of this session 


s not printed last month, brief comment on it may be made. In the first 


iper Dr. Karl J. Holzinger of the University of Chicago presented a tech- 


al critique of statistical methods as applied to mental and educational 


sts He gave new formulae for the determination of the reliability of 


sts and presented evidence concerning their scoring and organization. He 


eld that in some respects tests should be organized and scored more simply 


or 


an is the prevailing practice. The second paper, by Mr. E. R. Wood of 
State Normal School of Emporia, Kansas, was entitled ‘‘A Simplified 
ess for Obtaining Partial Correlations and Regression Equations of Three 
More Variables.’’ * Mr. Wood has worked out a graphical method which 
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makes it possible to calculate partial correlations and regression equations in 
a few minutes. The members present were much interested in this new 
method. 

A somewhat similar problem was attacked in a different way by Mr. 
Courtis who gave a number of tables to illustrate the procedure which he 
was describing. His procedure consisted in selecting individuals for com- 
parison who should be equal in the various aspects which might affect the 
measurement in question. The last paper, entitled ‘‘A Percental Graph,’’ 
was presented by Dr. A. 8. Otis in which the percental graph was used to 
illustrate the method of comparing scores in two different tests. 

These papers were discussed as a whole by Dr. Leonard P. Ayres. The 
members of the Association were greatly pleased to have Dr. Ayres meet 
with them and offer his illuminating comments upon the problems which were 
being considered. Several other members of the group also contributed to 
the discussion. 

The third program was held in a large auditorium on Thursday after- 
noon. At this meeting Dr. Ayres presided. Since this meeting was on the 
last day, the attendance was smaller than it otherwise would have been. The 
general subject of the program was ‘‘ Educational Costs and the Building 
Program.’’ 

The annual dinner was held on Thursday evening. An enthusiastic group 
of 50 attended the dinner and listened to the comprehensive, well-balanced, 
and critical survey of educational investigations for the past year presented 
by Dr. Theisen, the retiring president. 

A number of committees, which had been appointed at the preceding 
meeting, made reports. The first of these was the Committee on Educational 
Journals—chairman, Dr. Rugg. The committee reported that it had canvassed 
the relationships between a number of the educational journals in order to 
determine the extent of the overlapping in the subject matter of the articles 
printed in these journals, and considered further whether this overlapping 
was undesirable and might be avoided. It appeared from the study which was 
devoted to this matter that it was undesirable to attempt any formal or exact 
definition of the field of the respective journals. It was informally agreed 
that the JOURNAL OF EDUCATIONAL RESEARCH should emphasize articles of a 
practical import and that the Journal of Educational Psychology should be 
recognized as dealing especially with the more technical articles, but this 
arrangement is a purely informal one and binds neither journal to any definite 
action. 

This committee also had referred to it a suggestion of the National 
Research Council that the society should consider the project of making an 
annual review of the literature of educational research. The committee con- 
sidered that the association might profitably make an experiment in this 
direction. It learned that Dr. Buckingham, in connection with the N. E. A. 
committee for the coordination of educational research, had undertaken to 
collect a bibliography of educational research. Dr. Buckingham further offered 


to provide the Association with copies of this bibliography. The committee 
recommended that a committee be appointed by the president to undertake 
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is annual review of educational research literature for one year as an ex- 


nent and it should appoint whatever individuals it found desirable 
be responsible for certain divisions of the field. This recommendation was 
nded and the motion carried. 
The second committee to report was the one on reorganization, and the 
ving is the report of the committee—chairman, Dr. Woody. 
rhe committee appointed by the president of the Research Association 
msider the advisability of reorganizing the Association recommends that 
present form of organization be maintained. In making this recommenda- 
m the committee desires to say that it took into consideration the following 


That 92 percent of all members replying to the inquiry sent out, reported 
that the present form of organization is well-adapted for satisfactorily 
meeting the needs of its members. 

That under the present organization there is great flexibility in the 
arrangement of programs. 

That the interests of a majority of the members are general rather than 
highly specialized.’’ 

This report was adopted. 


The Committee on Affiliation or relations with other organizations, chair 


n, Dr. Whipple, reported that it had held a meeting during the autumn of 
1 


) 


22. At this meeting the plans of the Association were canvassed in relation 


e association keep in mind the desirability of avoiding much overlapping 


the plans of the National Society for the Study of Education and th 
tional Society of College Teachers of Education, both of which happened 
represented on the committee. It was found that the plans for the pro 
of the three associations for the coming meeting did not conflict, either 


the subject matter 


1f the programs or in the time. It appears that th 
ree associations are spontaneously developing differentiated functions. T! 
ng the case, the committee recommended that the program committee of 


1 of communicating with the other associations at the time it is making 


g 

plans for the annual meeting, in order that such overlapping might be 

led. This report was adopted. 

The Executive Committee considered an application from an organization 
I 


educational research on the Pacific Coast for affiliation with the Edu 


ational Research Association. This matter was presented by Dr. Dickso 


Executive Committee appointed a sub-committee consisting of M. E 
ggerty, V. E. Dickson, and Frank N. Freeman to draw up amendments which 


ild provide for such affiliation and present them for consideration. These 





endments were drawn up and approved by the Executive Committee. They 


ere then presented to the Association. The following were the proposed 


endments: 


eational research may become affili 





Regional organizations devoted to e 
ate members of this association upon recommendation of the Executive 
committee and approval of the association. 

Only organizations whose purpose and activities are in harmony with 
this association may become affiliate members, and in each case there 
shall be a reasonable assurance that such a regional organization gives 
promise of more than temporary existence. 














JOURNAL OF EDUCATIONAL RESEARCH Vol.7, No.3 


Such affiliated societies may elect a representative to this association who 

shall be a member in good standing of this association. 

The representatives of affiliated organizations together with the members 

of the executive committee shall constitute a council for the purpose of 

considering the problems arising out of affiliation. 

‘he proposal aroused lively discussion. It was generally recognized that 
it was desirable to encourage educational research and to promote sympathy 
with and an understanding of research among those who might not be quali 
fied for membership in the association. Although some fears were expressed 
that a formal affiliation would not serve any definite purpose, the association 
voted by a two-thirds majority to adopt the amendment. It was further voted 
to authorize the president to appoint a committee to report at the next 
meeting concerning the nature of the relationships of the society to affiliated 
rganizations and the policy which should be accepted. A further motion 

d that the executive committee should constitute this committee. The 
application of the Pacific coast organization was therefore postponed for 
consideration at the next year’s meeting. 

An amendment was adopted which makes the term of office of the Secre 
tary three years. 

The following officers were elected: 

President—Clifford Woody 
Vice-President—J. L. Stenquist 


Secretary-Treasurer—H. A. Greene 
The financial statement of the society for the year is as follows: 


Cash on hand, April 24, 1 
Receipts—From dues . 


Total 
Expenditures 
Subscriptions to Public School Publishing Co. ..$335.00 
Expenses of Executive Committee 68.00 
Expenses for clerical help, postage and printing 52.11 
Rebate on subscription overpaid 


Balance on hand 256.29 
Total $712.40 
Bills payable 
Printing, postage, 
Net assets 


38.18 


FRANK N. FREEMAN, 
Retiring Secretary-Treasurer. 
{ dited 


P. R. Stevenson. 
A. 3. Otis. 













